ARI  Research  Note  92-!>u 


Development  of  the  Personnel-Based 
System  Evaluation  Aid  (PER-SEVAL) 
Performance  Shaping  Functions 

Lawrence  H.  O'Brien,  Robert  Simon, 
and  Hariharan  Swaminathan 

Dynamics  Research  Corporation 


for 

Contracting  Officer’s  Representative 
Charles  Holman 


banned  Systems  Group 
John  L  IWJes,  Jr.,  Chief 

mHPRIHX  Division 
Robin  L  Keesse,  Director 


United  States  Army 

Research  Institute  for  the  Behavioral  and  Social  Sciences 

j  ;  .  f  .  ^proved  («  public  release;  distribution  is  unlimltwl 


U.S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 


A  Field  Operating  Agency  Under  the  Jurisdiction 
of  the  Deputy  Chief  of  Staff  for  Personnel 


EDGAR  M.  JOHNSON 
Technical  Director 


MICHAEL  D.  SHALER 
COL,  AR 
Commanding 


Research  accomplished  under  contract 
for  the  Department  of  the  Army 

Dynamics  Research  Corporation 

Technical  review  by 

Jonathan  Kaplan 
Michael  G.  Ruinsey 


NOTICES 


Accesion  For 


NTIS  CttA&| 
DilC  TAB 
Unannounced 
Justification 

4 

[J 

U 

By . 

Di  .t.  ibntwi  / 

. . . 

Availability  Cortes 

Dist 

Avail  and  |  or 

Special 

M 

DISTRIBUTION:  This  report  lias  been  cleared  for  release  to  tl»c  Defense  Teclmical  Information 
Center  (DTIC)  to  comply  with  regulatory  requirements.  It  las  been  given  no  primary  distribution 
other  lion  to  DTIC  and  will  bo  available  only  through  DTIC  or  tltc  National  Tccluucal 
Information  Service  (NTIS). 


FINAL  DISPOSITION:  This  report  nay  be  destroyed  when  it  is  no  longer  needed.  Please  do  not 
return  it  to  tlie  U.S.  Army  Research  Institute  for  tltc  Beluviotal  and  Social  Sciences. 

NOTE:  The  views,  opinions,  and  findings  in  this  report  are  those  of  tlte  autliorfs)  and  should  not 
be  construed  as  an  ofTtcial  Department  of  the  Army  position,  policy,  or  decision,  unless  so 
designated  by  otlter  authorized  documents. 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
OMB  No.  0704-0188 


pjDt<;  cu'a?*'  *C'  collection  of  information  ■$  estimated  to  average  *  «our  per  response,  including  the  time  for  reviewing  instructions,  searchma  existing  data  sources 

gatnenns'ans  ^amtur-ng  tne  data  needed,  and  completing  ana  reviewing  the  collection  of  information  Send  comments  regarding  this  burden  estimate  or  anv  otner  aspect  ot  tn»s 
collection  :♦  :nf'vmat.-:.'.*rciud;ng  suggestions  for  reducing  this  ouroen.  to  Washington  Headquarters  Services,  Directorate  tor  Information  Operations  and  Reports.  12  IS  Jefferson 
Davis  Hichway.  Suite  1204  Arlington.  i/a  22202-4302.  and  to  the  Office  of  Management  and  8udget.  Paperwork  Reduction  Project  (0704*0188),  Washington,  DC  20503 


1.  AGENCY  USE  ONLY  (Leave  blank)  2.  REPORT  DATE 

1992,  June 


!<.  TITlE  AND  SU8TITLE 

;  Development  of  the  Personnel-Based  System  Evaluation  Aid 
(PER-SEVAL)  Performance  Shaping  Functions 


*  6.  Al!“H08(Sl 


1  O'Brien,  Lawrence  H.;  Simon,  Robert;  and  Swaminathan, 
;  Hariharan 


7  PEF-ORMl\C  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Dynamics  Research  Corporation 
Systems  Division 
63  Concord  Street 
Wilmington,  MA  01887 


3.  REPORT  TYPE  AND  DATES  COVERED 
Final  Nov  86  -  Aug  90 


5.  FUNDING  NUMBERS 

MDA903-86-C-0412 

62785A 

791 

121 

C2 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


S  J?0t  •.on;,:.  v.ONITORING  AGENCV  NAME(S)  AND  ADDRESS(ES) 

U.S.  / rmy  Research  Institute  for  the  Behavioral  and 
Social  Sciences 
ATTN!  FSRI-S 
5001  Eisenhower  Avenue 

Alexandria,  VA  22333-5600  _ 


11.  NTARV  MQTES 

Contracting  Officer's  Representative,  Charles  Holman 


10.  SPONSORING  .  MONITORING 
AGENCY  REPORT  NUMBER 


ARI  Research  Note  92-50 


W.’  P -RlFU'-Cii*  A  'AILAHUI‘1  >1  AT'.ME  NT 


12b.  DISTRIBUTION  CODE 


Approved  for  public  release; 
distribution  is  unlimited. 


1.  •  tl"'  ,\Y>>vr  •<«. 
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performance  shaping  functions  were  developed.  It  describes  how  PER-SEVAL  will  use 
these  functions  to  identify  minimum  levels  of  personnel  characteristics  for  a  par¬ 
ticular  contractor's  design.  Finally,  procedures  for  future  validation  of  the 
functions  are  outlined. 

The  PER-SEVAL  performance  shaping  functions  were  developed  by  conducting  re¬ 
gression  analyses  of  data  obtained  from  the  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences'  Project  A  database.  They  predict  task  performance 
as  a  function  of  personnel  characteristics  and  training.  Separate  functions  are 
provided  for  different  types  of  tasks.  Two  types  of  training  variables  are  used 
in  the  performance  shaping  functions — frequency  and  recency  of  practice. 
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This  report  describes  how  the  Personnel-Based  System 
Evaluation  Aid  (PER-SEVAL)  performance  shaping  functions  were 
developed.  PER-SEVAL  is  one  of  six  automated  aids  being 
developed  under  the  HARDMAN  III  development  program.  The 
objective  of  PER-SEVAL  is  to  find  values  for  the  personnel 
characteristics  that  will  meet  system  performance  requirements 
given  fixed  values  for  conditions,  training,  and  design.  In 
essence,  PER-SEVAL  estimates  the  personnel  quality  requirements 
of  a  particular  contractor's  design. 

other  automated  tools  in  the  HARDMAN  III  contract  will 
assist  U.S.  Army  personnel  in  developing  system  performance 
requirements;  identifying  manpower,  personnel,  and  training 
constraints;  determining  maintenance  manpower  requirements;  and 
assessing  operator  workload.  HARDMAN  III  is  one  of  several 
automated  tools  being  developed  for  Army  analysts  by  the  U.S. 
Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
MANPRINT  Division. 
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DEVELOPMENT  OF  THE  PERSONNEL-BASED  SYSTEM  EVALUATION  AID 
(PER-SEVAL)  PERFORMANCE  SHAPING  FUNCTIONS 


EXECUTIVE  SUMMARY 


Requirement: 

To  ensure  the  personnel  quality  requirements  of  new  weapon 
systems ,  quantitative  methods  for  predicting  the  impact  of  per¬ 
sonnel  characteristics  on  soldier  performance  must  be  developed. 


Procedure : 

Researchers  conducted  regression  analyses  on  selected  data 
from  the  U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences  Project  A  data  base.  Separate  analyses  were 
conducted  for  different  types  of  tasks,  in  each  analysis,  an 
attempt  was  made  to  predict  performance  as  a  function  of  the 
Armed  Forces  Vocational  Aptitude  Battery  (ASVAB)  composite  and 
the  frequency  and  amount  of  sustainment  training. 


Findings: 

Performance  shaping  functions  were  developed  for  most  of  the 
task  types.  It  was  impossible  to  develop  functions  for  several 
types  of  tasks  because  there  were  so  few  instances  of  these  tasks 
in  the  Project  A  data  base. 


Utilization  of  Findings: 

The  performance  shaping  functions  will  be  incorporated  into 
the  Personnel-Based  System  Evaluation  Aid  (PER-SEVAL) .  PER-SEVAL 
will  assist  Army  analysts  in  assessing  the  personnel  quality  re¬ 
quirements  of  future  Army  systems.  The  functions  could  also  be 
used  in  other  tools  required  to  predict  task  performance  as  a 
function  of  aptitude  and  sustainment  training.  The  authors 
recommend  that  the  performance  shaping  functions  be  validated 
in  future  ARI  studies. 
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development  of  the  personnel-based  system  evaluation  aid 

(PER-SEVAL)  PERFORMANCE  SHAPING  FUNCTIONS 
Introduction 


Objective  of  Paper 

This  paper  has  two  objectives.  First,  it  describes  how  the 
Personnel-Based  System  Evaluation  Aid  (PER-SEVAL)  performance 
shaping  functions  were  developed.  Second,  it  describes  how  these 
functions  will  be  used  to  identify  minimum  levels  of  personnel 
characteristics  for  a  particular  contractor’s  design. 

The  paper  builds  on  two  earlier  reports:  the  PER-SEVAL 
concept  paper,  which  was  delivered  to  ARI  in  April  1987,  and  the 
PER-SEVAL  design  specifications,  which  were  delivered  to  ARI  in 
December  1987. 

Overview  of  PER-SEVAL 

PER-SEVAL  is  one  of  six  automated  aids  being  developed  under 
the  MANPRINT  methods  contract.  Figure  1  outlines  the  objective  of 
PER-SEVAL.  Performance  is  a  function  of  personnel 
characteristics,  conditions,  training  and  the  system  design  (and 
many  other  things  as  well,  but  these  are  the  variables  addressed 
by  PER-SEVAL) ,  The  objective  of  PER-SEVAL  is  to  find  values  for 
the  personnel  characteristics  that  will  meet  system  performance 
requirements  given  fixed  values  for  conditions,  training,  and 
design.  In  essence,  what  PER-SEVAL  does  is  to  estimate  the 
personnel  quality  requirements  of  a  particular  contractor's 
design . 


Performance  -  F  <P,C,T,D) 

P  *  Personnel  Characteristics 
C  -  Conditions 
T  -  Training 
D  »  Design 

Objective:  Find  Values  for  "P"  that  Meet  Performance 
Requirements  Given  Fixed  Values  of  C,  T,  D. 

Figure  1.  Objective  of  PER-SEVAL. 


The  personnel  quality  requirements  produced  by  the  PER-SEVAL 
Aid  will  be  part  of  the  overall  evaluation  of  a  contractor’s 
design.  Evaluations  may  be  made  as  early  as  the  proof-of- 
principle  phase  of  the  acquisition  process  and  would  probably  be 
continued  in  subsequent  phases.  The  primary  users  of  the 
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PER-SEVAL  Aid  would  be  the  Directorate  of  Combat  Developments 
personnel  who  provide  input  to  the  Cost  and  Operational 
Effectiveness  Analysis  (COEA)  and  the  Logistic  Support  Analysis 
(LSA) ;  and  the  logistics  division  of  the  program  manager's  staff 
who  develop  manpower  and  personnel  information  for  the  LSA. 

The  PER-SEVAL  Aid  receives  critical  inputs  from  three  other 
MANPRINT  methods  aids — The  System  Performance  and  RAM  Criteria 
Aid,  The  Personnel  Constraints  Aid,  and  The  Manpower-Based  System 
Evaluation  Aid.  The  System  Performance  and  RAM  Criteria  Aid 
(SPARC)  produces  estimates  of  system  performance  requirements. 

The  Manpower-Based  System  Evaluation  Aid  (MAN-SEVAL)  identifies 
the  jobs  and  tasks  associated  with  each  contractor’s  design.  The 
Personnel  Constraints  Aid  (P-CON)  describes  the  projected 
distribution  of  each  personnel  characteristic. 

The  PER-SEVAL  Aid  has  three  basic  components.  First,  the 
PER-SEVAL  Aid  has  a  set  of  performance  shaping  functions  that 
predict  performance  as  a  function  of  personnel  characteristics  and 
training.  Second,  the  PER-SEVAL  Aid  has  a  set  of  stressor 
degradation  algorithms  that  degrade  performance  to  reflect  the 
presence  of  critical  environmental  stressors.  Third,  the 
PER-SEVAL  Aid  has  a  set  of  operator  and  maintainer  models  that 
aggregate  the  performance  estimates  of  individual  tasks  and 
produce  estimates  of  system  performance. 

Figure  2  provides  an  overview  of  the  procedures  a  user  would 
employ  in  using  PER-SEVAL.  The  user  begins  an  application  of  the 
PER-SEVAL  Aid  by  applying  the  performance  shaping  functions  using 
the  mean  level  of  the  personnel  characteristics  and  the  estimated 
amount  of  training  for  the  new  system.  These  performance 
estimates  are  then  input  into  the  rtressor  degradation  algorithms 
where  performance  is  degraded  to  reflect  the  presence  of  the 
stressors.  Next,  the  revised  task  performance  estimates  are  input 
into  the  operator  and  maintainer  models  which  aggregate  them  to 
produce  estimates  of  system  performance.  Then,  required 
performance  is  compared  with  estimated  performance  at  either  the 
task  or  system  level  (the  user  selects  the  level) .  If 
performance  is  adequate,  the  PER-SEVAL  Aid  stops.  Otherwise,  the 
personnel  characteristics  are  incremented  or  decreased  and  the 
entire  process  is  iterated  until  required  performance  levels  are 
met . 

Overview  of  Performance  Shaping  Functions 

PER-SEVAL  performance  shaping  functions  predict  task 
performance  as  a  function  of  personnel  characteristics  and 
training.  Separate  functions  are  provided  for  different  types  of 
tasks.  Two  types  of  training  variables  are  used  in  the 
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Figure  2.  Overview  of  PER-SEVAL  aid  logic. 


performance  shaping  functions  —  frequency  and  recency  of 
practice.  The  primary  data  source  for  tne  development  of  the 
performance  shaping  functions  was  the  Project  A  data  base. 

Definition  of  personnel  characteristics. 

The  performance  shaping  functions  (PSFs)  attempt  to  predict 
performance  for  "stable  design-related"  characteristics.  These 
characteristics  are  defined  as  follows: 

A  design-related  personnel  characteristic  is  an  enduring 

human  attribute  that  has  a  significant  impact  on  operator  or 

maintainer  performance  and  has  information  available  to 

estimate  its  current  distribution  within  the  Army. 

One  of  the  ultimate  objectives  of  ARI  MANPRINT  tool 
development  efforts  is  to  allow  Army  users  to  compare  the  number 
of  people  required  at  or  above  a  particular  personnel 
characteristic  level  with  the  number  available  at  or  above  this 
level  (the  latter  is  produced  by  P-CON) .  This  type  of  comparison 
is  only  meaningful  for  stable  or  enduring  personnel 
characteristics.  For  the  same  reason,  a  personnel  characteristic 
must  either  have  data  available  to  describe  its  distribution 
within  each  Army  MOS  or  we  must  bo  able  to  identify  other  existing 
data  that  can  be  reasonably  generalized  to  Army  MOSs .  If  we 
cannot  describe  a  characteristic’s  distribution,  we  have  no  basis 
for  describing  . ts  availability  and  no  basis  for  setting  a 
constraint  in  i  CO 

To  be  a  design-related  personnel  characteristic,  a 
characteristic  must  be  related  to  operator  and  maintainer 
performance — namely,  task  performance  time  and/or  accuracy.  If  a 
characteristic  is  not  related  to  task  time  or  accuracy,  there  is 
little  a  contractor  can  do  to  design  a  system  to  accommodate  a 
given  characteristic  level.  Four  general  types  of  characteristics 
meet  the  criteria  described  above  —  cognitive,  perceptual, 
psychomotor,  and  physical  characteristics. 

Of  these  four  types  of  variables,  the  first  three  types 
(cognitive,  perceptual  and  psychomotor)  impact  how  well  a  task 
will  be  performed  while  the  last  type  of  characteristic  (physical 
characteristics)  primarily  determine  if  a  task  can  be  performed. 
Since  the  focus  of  PER-SEVAL  is  on  predicting  how  well  a  given 
population  can  perform  a  task,  the  PER-SEVAL  PSFs  focus  on  tasks 
falling  into  the  first  three  categories. 

Page  17  lists  the  specific  characteristics  included  in  the 
PER-SEVAL  PSFs. 
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Training  variables  in  performance  shaping  functions 


Originally,  we  intended  to  use  "amount  of  initial  training" 
as  the  training  variable  in  our  performance  shaping  functions . 
However,  two  problems  with  this  variable  were  identified.  First, 
there  was  a  lack  of  data  or  data  bases  which  could  be  used  to 
relate  this  variable  to  task  performance.  Second,  and  perhaps 
most  importantly,  to  use  this  variable  we  would  have  had  to  assume 
that  all  soldiers  had  just  graduated  from  initial  training  since 
development  of  models  to  predict  the  impact  of  intervening 
variables  on  learning  retention,  task  practice,  and  subsequent 
task  performance  would  be  very  complex. 

Because  of  these  problems,  it  appeared  that  we  would  have  to 
leave  training  completely  out  of  our  models.  However,  we  were 
able  to  identify  two  training-related  variables  in  the  Project  A 
data  base.  This  data  described  how  frequently  and  recently  within 
the  last  six  months  a  soldier  had  performed  a  task  prior  to  the 
hands-on  test .  Together  these  two  variables  can  be  viewed  as 
describing  the  amount  and  recency  of  practice  given  to  a 
particular  task.  Since  practice  is  one  of,  if  not  the  key, 
training  variable,  we  decided  to  use  these  variables  as  measures 
of  the  amount  of  sustainment  or  on-the-job  training.  Admittedly, 
these  variables  capture  only  a  small  part  of  the  total  system- 
specific  training  provided  to  Army  soldiers.  However,  these  are 
the  only  variables  on  which  data  was  available. 

Through  some  simple  assumptions  and  algorithms,  we  were  able 
to  develop  an  approach  for  converting  estimates  of  frequency  of 
performance  on  the  job  into  the  Project  A  frequency  and  recency 
metrics.  This  allowed  us  to  use  an  input  variable  (frequency  of 
performance  on  the  job)  that  will  be  more  meaningful  to  PER-SEVAL 
users . 

Qxfirylaw . of  !,.££££■ 

In  our  concept  of  the  PER-SEVAL,  performance  shaping 
functions  will  be  used  to  predict  the  performance  level  that  can 
be  expected  for  a  given  set  of  personnel  characteristic  levels  and 
amount  of  training.  The  PER-SEVAL  performance  shaping  functions 
will  actually  predict  a  relative  change  from  a  baseline  value 
rather  than  absolute  performance.  Also  note  that  the  performance 
shaping  functions  will  describe  generic  predictor-performance 
relationships  for  types  of  tasks  rather  than  for  specific  tasks. 

Table  1  displays  the  general  form  of  the  PER-SEVAL 
performance  shaping  functions.  Note  that  the  functions  predict  a 
2  score.  The  PER-SEVAL  program  will  convert  the  Z  score  into  the 
raw  score  using  a  standard  algorithm  for  converting  Z  scores  to 
raw  scores.  However,  for  the  mean  score,  the  program  will  use  the 
user’s  estimate  of  the  expected  accuracy  level  for  each  task 
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Standardized  Regression  Weights 


associated  with  the  specific  contractor's  design.  (The  time 
estimates  produced  by  MAN-SEVAL  are  also  based  on  these  same 
assumptions.)  This  approach  allows  us  to  use  a  generic 
predictionequation  associated  with  different  types  of  tasks  to 
predict  performance  on  a  particular  task  associated  with  a 
specific  contractor's  design.  The  mean  estimate  provided  by  the 
user  captures  the  unique  design  features  associated  with  a 
particular  task.  Thus,  we  assume  that  the  hardware/software 
design  determines  the  overall  or  mean  level  of  performance  of  a 
task  and  that  personnel  characteristics  or  abilities  determine 
scores  of  individual  soldiers  about  this  mean.  This  approach 
requires  certain  assumptions  —  some  statistical  and  some 
conceptual.  These  assumptions  are  described  in  detail  on  page  79. 


Mechanisms  for  generalizing  application  of  the  PSFs  to  new 
tasks . 

Development  of  the  PER-SEVAL  performance  shaping  functions  is 
different  than  the  typical  regression  analyses  conducted  in 
academic  psychology  because  we  are  attempting  to  develop  functions 
that  can  predict  performance  for  a  general  class  of  tasks  rather 
than  a  particular  task.  Our  ultimate  goal  is  to  predict 
performance  for  the  tasks  associated  with  new  weapon  systems .  Two 
assumptions  or  mechanisms  allow  us  to  make  generalized  predictions 
for  new  tasks.  First,  we  assume  that  the  generalized  relationships 
we  develop  for  a  particular  taxon  apply  to  all  tasks  which  fall 
into  that  taxon.  (On  page  87,  we  outline  a  set  of  procedures  for 
validating  this  assumption) .  Second,  we  use  the  functions  to 
predict  Z  scores  —  that  is  deviation  from  a  mean  value  which  is 
tied  to  .  specific  task's  overall  task  difficulty  within  a 
hardware/software  design.  These  two  assumptions  permit  us  to 
develop  functions  which  are  scale  invariant  —  that  is,  the 
functions  predict  performance  for  any  task  in  that  taxon  no  matter 
what  its  scale.  This  allows  us  to  generalize  beyond  the  specific 
types  of  scales  (e.g.,  per  cent  correct)  which  were  used  during 
PSF  development . 

History  Ql  ,tfr3,.ae£fQxmancg..,sIiaplrig  fu&cfcioi^cflncfipt. 

Our  concept  of  performance  shaping  functions  is  derived  from 
past  work  on  human  reliability  analysis.  Swain  (1967)  introduced 
the  term  "performance  shaping  factor"  to  describe  the  external  and 
internal  factors  which  modify  or  influence  human  performance. 

Since  that  time,  performance  shaping  factors  have  been  identified 
and  applied  in  a  wide  range  of  human  reliability  analyses.  A 
description  of  performance  shaping  factors  and  their  use  in  human 
reliability  analysis  is  provided  in  Miller  and  Swain  (1986),  and 
Meister  (1985)  .  Performance  shaping  factors  have  included 
"external"  variables  such  as  work  space  layout,  environmental 
conditions,  and  human  engineering  design,  and  internal  variables 
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such  as  training/experience,  skill  level,  intelligence,  perceptual 
abilities,  and  physical  condition  (Miller  and  Swain,  1987) .  In  a 
typical  human  reliability  analysis  using  these  factors,  task 
accuracy  estimates  are  first  adjusted  to  account  for  the  impact 
of  the  performance  shaping  factors  and  these  adjusted  estimates 
are  combined  in  a  reliability  model  to  produce  overall  relia¬ 
bility  estimates.  The  impacts  of  the  performance  shaping  factors 
on  performance  are  typically  expressed  as  a  percentage  change 
from  a  baseline.  Table  2  displays  some  percentage  values  that 
Swain  and  Guttman  (1983)  developed  to  describe  the  impact  of 
stress  on  task  accuracy  for  novice  and  skilled  workers. 

Data  on  the  impacts  of  performance  shaping  factors  may  be 
derived  from  empirical  studies  or  from  the  application  of  expert 
judgment  techniques.  Miller  and  Swain  (1987)  provide  a 
description  of  recent  developments  in  the  application  of  expert 
judgment  techniques. 

Although  not  labelled  as  "performance  shaping  factors" 
per  se,  the  concept  of  human  performance  shaping  factors  has  been 
used  in  other  areas  as  well.  Human  engineering  design  handbooks 
often  use  the  performance  shaping  function  approach  (percentage 
impact  on  a  baseline  for  different  types  of  tasks)  to  provide 
guidance  for  assessing  the  impact  of  environmental  conditions  or 
other  related  variables  on  human  performance.  For  example.  Figure 
3  lists  guidance  for  assessing  the  impact  of  wet  bulb  temperature 
on  performance  for  different  types  of  tasks  taken  from  the 
Handbook  of  Perception  and  Human  Performance,  Boff,  Kaufman,  & 
Thomas,  1986. 

Constraints  _on  Development  _of  Performance  Shaping  Functions 

Resource  and  time  constraints  had  a  significant  impact  on  the 
development  of  the  PER-SEVAL  performance  shaping  functions.  The 
general  philosophy  of  the  MANPRINT  methods  contract  was  to  develop 
automated  MANPRINT  aids  using  state-of-the-art  technology  and 
existing  data.  The  PER-SEVAL  development  schedule  reflected  this 
philosophy.  Consequently,  there  was  neither  time  nor  resources 
for 


a)  the  collection  of  additional  task  performance  data.  Thus, 
we  developed  the  functions  using  performance  data  available 
in  existing  data  bases. 

b)  validation  of  performance  shaping  function  development 
process.  (Page  87  describes  a  plan  for  validation) . 

The  goal  of  the  PER-SEVAL  performance  shaping  functions  is  an 
ambitious  one — development  of  a  generic  set  of  functions  for 
predicting  performance  as  a  function  of  personnel  characteristics 
and  training  using  existing  data  sources  that  can  be  applied 
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Table  2 

Model  Accounting  for  Stress  and  Experience  in 
Performing  Routine  Tasks* 


%  increase  in  Error 
Probability 


Stress  Level 

Skilled 

Novice 

Very  Low 

200 

200 

Optimum 

100 

100 

Moderately  High 

200 

400 

Extremely  High 

500 

100 

‘Derived  from  Swain,  A.D.,  and  Guttmann,  H.E.  {1983,  August).  Handbook  of  human 
raiiability  and  analysis  with  amphasis  on  nudear  power  plant  application  (Sandia 
National  Laboratories,  NUREG/CR-1278).  Washington,  DC:  U.S.  Nuclear  Regulatory 
Commission. 
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across  tasks  and  MOSs .  We  believe  we  have  constructed  a  set  of 
functions  that  can  accomplish  this  goal  and  can  be  incorporated 
into  an  automated  aid  that  can  be  used  by  Army  users  to  assess 
personnel  quality  requirements.  However,  we  recognize  that  there 
is  much  additional  work  that  can  and  should  be  done  to  improve 
these  functions  (page  87  describes  some  of  this  additional  work) . 
Our  philosophy  has  been  that  it  is  better  to  give  users  a  slightly 
imperfect  tool  that  can  help  them  in  the  near  term  rather  than  to 
tell  them  to  wait  while  the  "perfect  tool"  is  developed. 

Overview  of  Data  Sources  for  Development  of  Performance  Shaping 
Functions . 

The  primary  data  source  for  the  development  of  the  Per¬ 
formance  Shaping  Functions  was  API's  Manpower  and  Personnel 
Research  Division  (MPRD)  Project  A  data  base.  Project  A  is  more 
formally  known  as  the  project  for  "Improving  the  Selection,  Clas¬ 
sification,  and  Utilization  of  Army  Enlisted  Personnel."  To 
date,  Project  A  is  the  only  data  base  we  have  been  able  to  iden¬ 
tify  that  contained  the  data  needed  to  develop  the  performance 
shaping  functions.  More  specifically,  the  Project  A  data  base 
has  hands-on  performance  data,  personnel  characteristics,  and 


training 

data  for  nine  Army  MOS: 

113 

Infantryman 

13B 

Cannon  Crewman 

19E 

Armor  Crewman 

31C 

Single  Channel  Radio  Operator 

63B 

Light  Wheel  Vehicle  Mechanic 

64C 

Motor  Transport  Operator 

71L 

Administrative  Specialist 

91A 

Medical  Specialist 

95B 

Military  Police 

The  hands-on  performance  data  includes  both  accuracy  and  time 
data.  To  facilitate  aggregation  across  tasks,  the  hands-on 
accuracy  measure  used  on  almost  all  the  Project  A  tasks  was  "  % 
steps  correct."  While  this  measure  met  the  needs  of  the  Project  A 
study,  it  is,  admittedly,  not  the  ideal  performance  measure  for 
developing  PSFs  for  predicting  weapon  system  task  performance  for 
certain  types  of  tasks.  (Page  87  describes  alternative  measures 
for  achieving  this  objective.)  However,  since  it  was  the 
predominant  type  of  accuracy  measure  in  the  Project  A  data  base, 
we  had  to  use  it.  Still,  no  matter  what  measure  was  used,  we  had 
the  problem  of  generalizing  to  other  measures  or  scales 
(see  page  7) . 
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The  Project  A  data  base  contained  time  data  on  many  but  not 
all  of  the  hands-on  tasks.  Appendix  A  lists,  by  MOS,  all  of  the 
hands-on  tasks  contained  in  the  Project  A  data  base  and  their  mean 
accuracy  and  time  measures . 

The  Project  A  data  also  contained  personnel  characteristic 
scores  for  each  individual  in  the  data  base.  Table  3  summarizes 
the  personnel  characteristic  measures  that  are  included  in  the 
Project  A  data  base.  Note  that  the  Project  A  data  contained 
values  on  seven  new  predictors  developed  during  the  initial  stages 
of  Project  A.  These  seven  new  predictors  are  actually  composites 
of  several  subtests  (see  Table  4).  The  ASVAB  area  scores  are  also 
composites  of  several  subtests  (see  Table  4) . 

The  Project  A  data  base  also  had  data  on  the  frequency  and 
recency  with  which  the  hands-on  tasks  were  performed.  Table  5 
lists  the  scales  that  were  used  to  assess  these  measures. 

In  addition  to  the  Project  A  data  base,  the  other  data  source 
used  for  performance  shaping  functions  were  recent  review  articles 
(Genaidy,  Asfour,  and  Tritar,  1988;  and  Genaidy  and  Asfour,  1987) 
on  models  that  predict  performance  on  manual  handling  tasks . 
Selected  regression  models  from  these  articles  will  be  used  to 
predict  performance  for  gross  motor  tasks. 

Because  we  are  using  the  manual  handling  regression  models 
"as  is"  and  not  developing  them  "from  scratch, "  there  is  no 
discussion  of  these  models  in  the  description  of  the  development 
of  performance  shaping  functions  which  follows.  These  models 
were  described  in  the  "PER-SEVAL  Design  Specifications"  submitted 
to  ARI  in  December  1987. 
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Personnel  Characteristics  In  Project  A  Data  Base 
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Naw  Project  A  Predictor 


Table  4 


Subtests  in  New  Project  A  Personnel  Characteristics  Composites  and  ASVAB 
Area  Composites 


COMPOSITE  SCORE 

SUBTESTS 

ADDITIONAL  DESCRIPTION 

1.  Naw  Projaot  A 
Paraonnal 
Charactarlatlcs 

Numerical  Spaad 

Numbar  Memory  Taat 

Mean  for  Final  Raaponae  (Final  Declalon  Time) 

and  Accuracy 

Number  Memory  Taat 

Mean  Hit  Rata  (Initial  Declalon  Tima) 

(B3CCNMSA) 

Numbar  Memory  Taat 

Pooled  Mean  Operation  Tima  (Mean  Declalon  Time) 

Numbar  Memory  Taat 

Mean  for  Initial  Input  (Percent  Correct) 

Ovarall  Spatial 

Aeeembllng  Objecta  Taat 

Nona 

(B3PCSPAT) 

Map  Taat 

Nona 

Maze  Taat 

Nona 

Object  Rotation  Taat 

Nona 

Orlantatlon  Taat 

Nona 

Flgural  Reasoning  Teat 

Nona 

Comptax  Parcaptual 

Perceptual  Spaad  and 

Mean  Hit  Rata  (Percent  Correct) 

Accuracy 

Accuracy  Taat 

(B3CCCPAC) 

Target  Identification  Taat 

Mean  Hit  Rata  (Percent  Correct) 

Short  Tarm  Memory  Taat 

Mean  Hit  Rata  (Percent  Correct) 

Complex  Parcaptual 

Parcaptual  Spaad  and 

Mean  of  Trimmed  Declalon  Time 

Spaad 

Accuracy  Taat 

(B3CCCPSP) 

Target  Identification  Taat 

Mean  of  Trimmed  Declalon  Tima 

Short-Term  Memory  Taat 

Mean  of  Trimmed  Declalon  Tima 

Payohomotor 

Cannon  Shoot  Teat 

Mean  Aba.  Tima  Dtecrep 

(B3CCPSYM) 

Target  Shoot  Taat 

Mean  Log  (Diet  ♦  1) 

Target  Shoot  Taat 

Mean  Tima  to  Fire 

Target  Tracking  1 

Mean  Log  (Dlst  ♦  1) 

Target  Tracking  2 

Mean  Log  (Diet  ♦  1) 

Pooled  Mean  Movement 
Tima 

Nona 

Slmpla  Raactlon 

Choice  Raactlon 

Mean  Percent  Correct 

Accuracy 

(B3CCSRAC) 

Slmpla  Raactlon 

Mean  Percent  Correct 

Slmpla  Raactlon 

Choice  Reaction  Time 

Mean  of  Trimmed  Choice  Declalon  Time 

Spaad 

Slmpla  Raactlon  Tima 

Mean  of  Trimmed  Choice  Declalon  Tima 

(B3CCSRSP) 
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Table  4 


Subtests  In  New  Project  A  Personnel  Characteristics  Composites  and  ASVAB 
Area  Composites  (Cont.) 


COMPOSITE  SCORE 


II.  ASVAB  Area 
Composltas 


Clerical  (CL) 


Combat  (CO) 


Electronics  Repair 
(EL) 


Field  Artillery  (FA) 


Qenarsl  Mein* 
tenance  ((Ml) 


Qeneral  Technical 
(GT) 


Mechanical 
Maintenance  (MM) 


Operators  end 
Food  (OF) 


Surveillance  and 

Communication 

(SC) 


Skilled  Technical 
(ST) 


SUBTESTS 


ADDITIONAL  DESCRIPTION 


Arithmetic  Reasoning  ASVAB  Subtest  -  AR 
Math  Knowledge  ASVAB  Subteat  •  MK 
Verbal  Equivalent  ASVAB  Subteet  •  VE1 


Auto  A  Shop  Information  ASVAB  Subteet  •  AS 
Mechanical  Comprehension  ASVAB  Subteet  -  MC 


Electronics  Information  ASVAB  Subteet  -  El 
General  Science  ASVAB  Subteet  •  GS 


Coding  Speed  ASVAB  Subteet  •  CS 


Numerical  Operations  ASVAB  Subteet  •  NO 


1  The  Verbal  Equivalent  ASVAB  Subteet  (VE)  la  formed  by  combining  scores  from  the  Paragraph 
Comprehension  (PC)  end  Word  Knowledge  (WK)  ASVAB  subteet*. 
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Table  5 


Project  A  Task  Frequency  and  Recency  Scales 


FREQUENCY 


•  *  Not  at  All 

••  1-2  Times  (per  Six  Months) 

••  3-5  Times  (per  Six  Months) 

••  6-10  Times  (per  Six  Months) 

•*  More  than  10  Times  (per  Six  Months) 


RECENCY 

••  During  Past  Month 
••  1-3  Months  Ago 
••  4-6  Months  Ago 
••  More  than  Six  Months  Ago 
••  Never 
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Preparation  of  Data  for  Entry  into  Regression  Analyses 


Selection  of  Personnel  Characteristi .~s 

Seven  factors  were  con^'iered  in  selecting  the  personnel 
characteristics  to  be  included  in  the  PSFs: 

(1)  The  personnel  characteristic  had  to  be  included  in  the 
Project  A  data  base 

(2)  The  characteristic  had  to  be  a  stable  design-related 
characteristic  as  defined  on  page  4. 

(3)  The  characteristic  had  to  have  sufficient  variability  to 
be  used  as  a  predictor.  Some  of  the  characteristics  we  had 
initially  hoped  to  include  (i.e.,  the  PULHES  scores)  did  not 
have  such  variability.  For  example,  on  some  of  the  PULHES 
scores,  more  than  95%  of  the  Project  A  population  had  the 
same  score . 

(4)  Most  of  the  Project  A  population  had  to  have  scores  on 
the  characteristic.  For  instance,  we  originally  hoped  to 
include  MEPC',AT  as  a  characteristic.  But  only  one  fifth  of 
the  Project  A  population  had  scores  on  this  variable.  Because 
this  one  fifth  was  spread  across  the  different  types  of 
tasks,  tnere  was  an  insufficient  sample  to  use  this 
characteristic. 

(5)  A  characteristic  was  excluded  if  it  was  incorporated 
into  a  higher  level  measure.  (For  example,  all  of  the  new 
predictors  in  the  Project  A  data  base  were  combined  into 
seven  composite  scores) .  This  approach  was  taken  to:  (a) 
minimize  the  number  of  characteristics  included  in  the  PSFs, 
and  (b)  to  improve  the  reliability  of  the  characteristics 
(the  data  suggested  that  the  aggregate  measures  are  more 
reliable  than  the  lower  lave:  measures) . 

(6)  A  characteristic  was  excluded  if  it  was  expected  that  it 
would  only  be  related  to  performance  on  gross  motor-heavy 
tasks  since  predictions  for  these  tasks  would  be  handled  by 
the  material  handling  models  (see  page  11) .  Three  physical 
characteristics  were  excluded  for  this  reason — height, 
weight,  and  diastolic  blood  pressure. 

(7)  The  only  A.SVAB  measures  which  were  included  were  the 
ASVAB  area  composites  &ud  the  reading  grade  level  derived 
from  the  GT  composite  using  conversion  algorithms  described 
in  Grafton  (in  press) .  Other  ASVAB  measures  which  were 
available  (e.g.,  ASVAB  Quantitative  and  ASVAB  Verbal)  were 
excluded  because  of  their  redundancy  with  the  ASVAB  area 
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composite  scores.  The  area  composites  are  the  measures  used 
to  control  entry  into  MOSs .  Reading  grade  level  was  included, 
despite  its  near  perfect  correlation  with  the  GT  composite, 
because  of  its  possible  contribution  to  the  prediction  of 
performance  in  MOSs  which  did  not  use  the  GT  composite  as  a 
selection  tool. 

Table  6  lists  the  final  set  of  personnel  characteristics  that 
were  included  in  the  regression  analyses  used  to  develop  the  PSFs. 
The  characteristics  are  divided  into  three  groups — cognitive, 
perceptual,  and  psychomotor.  Appendix  B  documents  our  rationale 
for  excluding  particular  Project  A  characteristics. 


The  MPT2  task  taxonomy  has  two  major  uses.  First,  it  was  used 
to  guide  the  development  of  the  PSFs  —  different  functions  were 
developed  for  the  different  taxons  in  the  taxonomy.  Second,  it  was 
used,  to  guide  the  development  of  the  stressor  degradation 
algorithms  —  different  algorithms  were  developed  for  different 
types  of  tasks. 

In  developing  the  MPT2  task  taxonomy,  we  attempted  to  develop 
a  classification  scheme  which  would:  (a)  provide  the  minimum 
number  of  taxons  needed  to  achieve  the  two  objectives  described 
above,  and  (2)  classify  tasks  and  not  task  element:.-.  The  first 
objective  was  important  because  we  want  to  minimize  «'ser  input 
requirements  and  PSF  development  costs.  The  latter  objective  was 
important  because  we  want  the  PER-SEVAL  models  to  be  applicable  at 
the  task  level.  That  is,  we  want  users  to  be  able  to  assign  an 
individual  task  to  one  or  more  taxons  without  requiring  them  to 
identify  specific  elements  constituting  that  task.  In  doing  so, 
we  can  significantly  reduce  user  input  data  requirements  (users 
who  want  to  apply  the  models  at  the  task  element  level  can  do  so) . 
It  should  be  noted  that  many  behavioral  classification  schemes, 
such  as  Fleishman's  (Fleishman  and  Quaintance 's,  1984),  are  very 
detailed  and  are  more  applicable  at  the  task  element  level. 

The  PER-SEVAL  task  taxonomy  is  primarily  an  expansion  of 
Berliner's  (196M  task  taxonomy.  However,  an  attempt  was  made  to 
incorporate  key  features  of  Wicken's  (1981)  structure  for 
processing  resources.  These  two  structures  are  reasonably 
congruent  with  one  another.  Task  types  were  eliminated  which, 
while  possible  to  imagine  on  a  theoretical  basis,  seldom  occur  in 
the  Army  a.g.,  auditory  pattern  recognition/discrimination). 

Table  7  displays  the  PER-SEVAL  task  taxonomy.  Some  of  the  lower 
level  taxons  in  the  hierarchy  (see  the  highlighted  taxons  in 
Table  7)  are  only  used  in  the  stressor  degradation  algorithms  and 
are  not  used  in  the  PSFs. 
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Table  6 

Personnel  Characteristics  Used  to  Develop  New  PSFs 


Type _ 

Cognitive  •  ASVAB  Area  Composites 

SC  =  Surveillance  Communications 

CO  =  Combat 

FA  =  Field  Artillery 

OF  =  Operators  and  Food 

ST  =  Skilled  Technical 

GT  =  General  Technical 

GM  =  General  Maintenance 

EL  s  Electronics 

CL  =  Clerical 

MM  s  Mechanical  Maintenance 

•  Numerical  Speed  and  Accuracy* 

•  Reading  Grade  Level 

•  Spatial* 

Perceptual  *  Complex  Perceptual  Accuracy* 

•  Complex  Perceptual  Speed* 

Psychomotor  •  Psychomotor* 

•  Simple  Reaction  Speed* 

•  Simple  Reaction  Accuracy* 

*  N  w  °roject  A  Predictor 
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Table  7 


MPT2  Task  Taxonomy 


Type 

Taxon 

Perceptual 

•  Visual  Recognition/Discrimination 

Cognitive 

•  Numerical  Analysis 

•  Information  Processing/Problem  Solving 

Motor 

•  Fine  Motor  -  Discrete 

•  Fine  Motor  -  Continuous 

«  Gross  Motor  -  Light 

•  Gross  Motor  -  Heavy 

-  Lifting,  Lowering* 

-  Torqulng/Pulllng* 

-  Carrying* 

Communication 

•  Oral 

•  Reading  and  Writing 

pig  s  this  level  of  taxon  only  used  in  stressor  degradation 
models 

*  These  taxons  used  only  in  material  handling  models 
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Definitions  and  examples  of  each  of  the  taxons  are  provided  in 
Appendix  C. 

Linkage  of  Personnel  Characteristics  to  Task  Taxonomy  Categories 

Table  8  displays  our  estimates  of  the  personnel 
characteristics  that  can  be  expected  to  predict  performance  for 
each  of  the  taxons  in  the  task  taxonomy.  ASVAB  area  composite  is 
listed  as  a  potential  predictor  for  each  taxon.  Four  of  the  new 
Project  A  predictors  (complex  perceptual  accuracy,  complex 
perceptual  speed,  simple  reaction  speed,  and  simple  reaction 
accuracy)  are  also  listed  as  potential  predictors  for  every  taxon. 
However,  the  two  accuracy  measures  (complex  perceptual  accuracy, 
simple  reaction  accuracy)  were  used  to  predict  task  accuracy  and 
the  two  speed  measures  (complex  perceptual  speed  and  simple 
reaction  speed)  were  used  to  predict  task  time.  The  logic 
underlying  these  assignments  was  that  these  composites  were 
complex  and  not  easily  assigned  to  a  particular  taxon.  The 
remaining  two  Project  A  predictors  (numerical  speed  and  accuracy 
and  psychomotor)  could  be  readily  tied  to  specific  taxons. 
Numerical  speed  and  accuracy  is  expected  to  be  a  predictor  of  the 
numerical  taxon.  Psychomotor  is  expected  to  be  a  predictor  of  the 
four  psychomotor  taxons.  Reading  grade  level  is  expected  to  be  a' 
predictor  of  the  communication  -  reading  and  writing  taxon. 

Assignment.,,  of,  Pro tect-A,  Tasks  to  Taxons 

Using  the  definitions  listed  in  Appendix  C,  DRC  staff 
assigned  each  of  the  Project  A  hands-on  tasks  to  one  or  more  of 
the  taxons.  Each  task  could  be  assigned  to  a  maximum  of  three 
taxons.  We  also  estimated  the  expected  percentage  of  task 
elements  involving  each  taxon.  This  process  paralleled  the 
(expected)  approach  that  users  will  take  in  assigning  tasks  to 
taxons  in  PER-SEVAL  (see  page  77  for  a  description  of  this 
process) .  The  assignments  and  estimated  percentages  for  each  task 
are  listed  in  Appendix  A. 

Table  9  displays  the  distribution  of  the  hands-on  tasks 
across  taxons  within  each  MOS  based  on  the  primary  taxon 
assignment.  Note  that  one  of  the  taxons  (gross  motor-heavy)  was 
not  represented  in  the  Project  A  data  base.  This  does  not  pose  a 
problem  since  we  planned  on  using  existing  manual  handling  models 
for  this  type  of  task  (see  page  12) .  For  several  of  the  other 
taxons  (e.g.,  visual  recongnition/  discrimination,  gross  motor- 
light),  there  was  a  small  number  of  tasks  in  the  Project  A  data 
base.  This  posed  a  problem  since  we  needed  multiple  tasks  within 
the  same  taxon  in  an  MOS  to  build  a  taxon  performance  measure. 
(Without  such  a  measure,  we  cannot  develop  a  PSF  for  that  taxon.) 
To  overcome  this  problem,  we  began  to  examine  the  knowledge  test 
items  in  the  Project  A  data  base  as  a  possible  additional  source 
of  task  items.  We  did  this  because  we  believed  that  for  certain 
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Tabie  8 

Personnel  Characteristics  Expected  to  be  Predictors  of  Taxon  Performance  Measures 
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'This  characteristic  is  unique  to  the  Project  A  data 
T  =  Predictor  of  TIME  only 
A  =  Predictor  of  ACCURACY  only 


Table 
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taxons  (e.g.,  communication-reading/writing)  there  was  a  great 
deal  of  similarity  in  the  way  that  Project  A  hands-on  and 
knowledge  items  were  measured — that  is,  actual  performance  of  the 
task  tapped  by  the  hands-on  measures  played  a  small  role  in 
overall  task  performance.  Thus,  we  decided  to  include  knowledge 
items  for  the  four  taxons  without  a  significant  psychomotor 
component,  (i.e.,  visual  recognition/discrimination,  cognitive- 
numeric,  cognitive-reasoning/problem  solving/decision  making,  and 
communication  reading/writing) .  Pages  26  to  36  describe  the 
knowledge  items  included  in  each  taxon. 

Selection  of  . Tasks.  For  Taxon  Measures 

In  order  to  predict  performance,  we  selected  a  set  of  tasks 
to  represent  each  taxon.  Since  we  intended  to  construct  taxon 
performance  scores  by  aggregating  across  tasks  falling  into  that 
taxon  for  a  particular  individual,  all  of  the  tasks  selected  for  a 
particular  taxon  had  to  come  from  the  same  MOS.  Two  criteria  were 
used  to  determine  which  MOS  would  represent  a  particular  taxon. 
First,  the  MOS  had  to  have  a  relatively  large  number  of  tasks 
falling  into  a  particular  taxon.  It  is  important  to  stress  the 
word  "relatively"  because  for  some  taxons  the  maximum  number  of 
tasks  within  any  MOS  was  only  2  or  three.  Second,  where  there  were 
several  MOSs  to  select  from,  we  selected  the  MOS  which  (a)  had 
available  training  frequency  and  recency  and  time  data  and  (b)  had 
a  relatively  large  number  of  hands-on  task  items.  The  emphasis  on 
the  hands-on  measures  reflects  our  overall  preference  for  the 
hands-on  measures. 

In  selecting  tasks  to  represent  a  taxon,  we  also  examined  the 
contribution  of  individual  tasks  to  overall  scale  consistency 
(coefficient  alpha) .  We  used  this  examination  as  a  statistical 
check  on  our  taxon  assignments.  Assignments  for  tasks  which  were 
not  consistent  with  the  overall  scale  were  reexamined.  This  was 
accomplished  by  reviewing  the  Project  A  descriptions.  Based  on 
this  review,  taxon  assignments  were  changed  for  a  few  of  the 
tasks.  However,  if  the  taxon  assignment  was  deemed  appropriate,  it 
was  left  in  the  taxon  measure  despite  its  lack  of  statistical 
consistency  with  the  overall  measure.  We  used  this  procedure 
because  we  wanted  to  take  a  predominantly  rational  rather  than  a 
purely  empirical  approach  to  the  construction  of  taxon  scale 
measures . 

Table  10  lists  the  MOSs  selected  to  represent  each  taxon  and 
the  types  of  tasks  included  in  each  taxon  measure.  A  more 
detailed  description  of  the  tasks  selected  for  each  taxon  follows. 

lHa.ua  1_  recognition/discrimination . 

Table  11  summarizes  the  tasks  used  to  construct  the 
performance  measures' for  this  taxon.  Only  two  MOSs  (11B  and  64C) 
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Summary  of  MOSs  and  Tasks  Used  to  Construct  Taxon  Measures 
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had  tasks  in  this  taxon  and  each  of  these  only  had  one  task.  The 
11B  task  (Conduct  Day  and  Night  Surveillance  Without  the  Aid  of 
Electronic  Devices)  was  especially  interesting  because  rather  than 
using  "%  steps  correct, "  a  measure  of  the  %  correct  visual 
identifications  was  used.  (The  actual  measure  was  targets 
correctly  located  in  one  minute  plus  total  targets  correctly 
located  minus  false  detections) .  Consequently,  we  decided  to  use 
11B  as  the  source  for  developing  this  taxon.  To  supplement  the 
one  hands-on  task  for  11B,  we  decided  to  use  one  knowledge  item 
for  the  task  "Identify  Armored  Vehicles."  In  testing  this  item, 
soldiers  were  shown  photographs  of  actual  armored  vehicles  and 
asked  to  identify  the  vehicle  from  a  set  of  choices. 
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Cognitive  -  numerical. 


Table  12  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon .  Only  MOS  95B,  had  more  than 
two  tasks  falling  into  this  taxon  — hence,  95B  data  was  used  to 
develop  the  cognitive-numerical  taxon. 
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Cognitive  -  reasoning/problem  solving/deci sion  making. 


Table  13  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon.  MOS  31C  had  five  hands-on 
tasks  falling  into  this  taxon  and  three  tasks  with  clearly 
relevant  knowledge  measures,  which  were  also  used  in  the  taxon 
measure . 
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:  fat  Uta  column  WmM  TYPE,  ~HoT  rapfamantu  Handa-OtvT.aka  tn  tha  Profact  A  Coneurrant  VaHdtty  Oatabaaa,  and  "Know"  rapraaan'a  knowledge  or  paper  and  panel!  taaka. 


Table  14  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon.  Since  most  of  the  Project  A 
hands-on  measures  fell  into  this  taxon  (this  is  not  surprising 
since  the  %  steps  correct  metric  is  most  appropriate  for  this  type 
of  task) ,  there  were  many  M'OSs  to  select  from.  We  selected  95B 
because  it  had  training  frequency  and  recency  data  for  each  fine 
motor  -  discrete  task  and  because  it  had  time  data  available  for 
the  vast  majority  (eight  out  of  ten)  of  these  tasks. 
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i:  In  tti*  eohuntt  label  ad  TYPE,  "KoT“  repraunta  Hande-On-Teeka  In  tha  Pro)  act  A  Cert  currant  Validity  Databaaa,  and  "Know"  rapraaanta  knowledge  or  paper  and  pancll  taaka. 


Fine  motor  -  continuous. 


There  was  only  one  task  falling  into  this  taxon  in  the  entire 
Project  A  data  base — Operate  Tractor  and  Semitrailer  from  MOS  64C. 
Additionally,  this  task  was  tested  using  a  metric  (i.e.,  %  steps 
correct)  that  we  felt  didn’t  adequately  measure  the  "fine  motor- 
continuous"  aspects  of  the  task.  Consequently,  we  decided  not  to 
attempt  to  build  a  PSF  for  this  taxon.  Page  87  describes  our 
approach  for  dealing  with  the  lack  of  PSF  for  this  taxon. 


34 


ttrofis  motor  -  light. 


Table  15  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon.  We  decided  to  use  11B  since 
it  was  the  only  MOS  with  more  than  one  task  falling  into  this 
taxon. 
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Description  of  Tasks  Used  in  Constructing  Taxon  Measure:  Gross  Motor  -  Light 
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Gross  motor  -  heavy. 

No  Project  A  tasks  fell  into  this  taxon.  Performance  for 
tasks  falling  into  this  taxon  will  be  predicted  using  the 
materials  handling  models  (see  page  11) . 
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Communication  -  oral. 

Table  16  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon.  Both  19E  and  95B  had  two 
tasks  falling  into  this  taxon.  We  decided  to  use  19E  since  this 
MOS  contained  weapons  system  operators. 
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Communication  -  readina/wrltlnq . 


Table  17  summarizes  the  tasks  used  to  construct  the 
performance  measures  for  this  taxon.  71L  had  the  most  hands-on 
tasks  (3)  falling  into  this  taxon.  In  addition,  71L  had  a  number 
of  clearly  relevant  knowledge  items  which  fell  into  this  taxon 
(see  Table  17) .  Most  of  these  items  involved  reading  and 
evaluating  typed  material. 


Description  of  Tasks  Used  in  Constructing  Taxon  Measure:  Communication  -  Reading  and  Writing 
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MOTE:  In  the  column  labeled  TYPE,  *HoT~  represents  Kande-Of>-Taeka  la  the  Profact  A  Concurrent  Validity  Database,  and  “KnoaT  represents  knowledge  or  pc  par  and  pencil  tasks. 


Construction  of  Criterion  Measures 


The  objective  of  the  PSF  development  effort  was  to  develop 
functions  to  predict  performance  for  different  types  of  tasks  as  a 
function  of  personnel  characteristics  and  training.  We  are 
interested  in  predicting  performance  for  a  task  type  rather  than  a 
specific  individual  task.  Thus,  our  dependent  measure  was  mean 
task  performance  for  a  particular  task  type  rather  than 
performance  on  a  specific  task. 

To  construct  mean  task  performance  measures  for  each  taxon, 
we  first  developed  standardized  scores  for  each  task  by 
calculating  the  mean  and  standard  deviation  for  the  MOS  on  that 
task.  We  then  took  the  mean  of  these  standardized  scores  across 
the  tasks  falling  into  the  taxon  for  a  particular  individual.  We 
used  standardized  scores  because  tasks  falling  into  the  same  taxon 
sometimes  used  different  scales.  For  the  most  part,  w%  steps 
correct"  was  used  as  the  criterion  accuracy  measure  for  Project  A 
tasks.  However,  for  a  number  of  tasks,  other  scales  (e.g.,  total 
targets  correctly  located)  were  used. 

The  same  procedure  was  used  to  construct  mean  values  for  both 
time  and  accuracy:  standardized  scores  were  developed  for  each 
task  and  the  standardized  scores  were  averaged  to  create  an 
overall  taxon  measure.  Time  values  were  not  available  for  all 
Project  A  tasks;  so  in  some  cases  the  number  of  tasks  used  to 
construct  the  mean  time  values  was  different  than  the  number  of 
tasks  used  to  calculate  the  mean  accuracy  values  (see  Table  10) . 

Construct  ion.  o£  .Predictor  Measures.... 

Table  18  summarizes  the  predictor  variables  used  to  develop 
the  PSFs  and  the  calculations,  if  any,  that  were  needed  to  create 
these  variables. 

Construction  of  reading  grade  level  score. 

A  reading  grade  level  (RGL)  score  was  calculated  using  a 
transformation  table  developed  by  Grafton  (in  press) .  The  table 
lists  values  for  converting  scores  on  the  GT  ASVAB  area  composite 
to  RGL. 

Calc uIatlQH.,QiLmeaa.., training  frequency  anti  rficency_acQr.es  ■ 

Mean  training  frequency  and  recency  scores  were  calculated 
for  each  taxon  by  averaging  across  the  tasks  which  fell  into  tr-.st 
taxon.  Frequency  and  recency  scores  were  not  available  for  ajj. 
tasks.  (See  Table  19) 
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Table  18 


Calculations  Required  to  Construct 

Predictor  Variables 

PREDICTOR 

CALCULATIONS  REQUIRED 

ASVAB  Area  Composites 

None 

Numerical  Speed  and  Accuracy 

None 

Reading  Grade  Level 

Derived  from  GT  In 

Accordance  with 

Grafton  (In  press) 

Spatial 

None 

Complex  Perceptual  Accuracy 

None 

Complex  Perceptual  Speed 

None 

Psychomotor 

None 

Simple  Reaction  Speed 

None 

Simple  Reaction  Accuracy 

None 

Frequency 

Calculated  by  Averaging 

Across  Tasks  In  Taxon 

Recency 

Calculated  by  Averaging 

Across  Tasks  in  Taxon 

Frequency-Recency 

Interaction  Term 

Calculated  by  Multiplying 
Frequency  and  Recency  Scores 

Accuracy* 

*  Used  as  a  predictor  tor  time  only 
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Frequency  and  Recency  Scares  per  Taxon 


Communication  -  19E  N/A  N/A  N/A  N/A 

Oral 


Construction  of  f reauencv-recency  interaction  term. 


We  hypothesized  that  there  would  be  an  interaction  between 
training  frequency  and  recency  in  terms  of  their  impact  on 
performance.  For  example,  one  might  expect  the  impact  of  recency 
on  performance  to  vary  depending  on  how  frequently  the  task  was 
performed.  To  include  this  interaction  in  the  PSFs,  we 
constructed  an  interaction  term  by  multiplying  frequency  and 
recency. 
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Results  ot  Regression  Analyses 


Two  sets  of  regression  analyses  were  conducted  to  develop  the 
PSFs  for  each  taxon.  In  the  first  set  of  regression  analyses, 
performance  was  predicted  as  a  function  of  personnel 
characteristics  and  training  without  correcting  for  restriction  of 
range  in  ASVAB  area  composites.  In  the  second  set  of  regression 
analyses,  corrections  for  these  factors  were  applied.  The  actual 
PSFs  were  constructed  from  the  second  set  of  analyses — that  is, 
the  analyses  with  the  correction  factors.  Results  from  the  first 
set  of  analyses  are  presented  to  show  the  impact  of  the  correction 
factors . 

Each  set  of  analyses  was  conducted  in  the  following  manner: 

Predictors . 

A  different  set  of  predictors  was  used  for  each  taxon  (see 
Table  20) .  The  predictors  employed  were  based  on  the 
characteristic-taxon  relationships  described  on  page  21.  Wherever 
data  was  available,  frequency  and  recency  and  their  interaction 
are  used  as  predictors  for  each  taxon.  Actually,  10  separate 
regression  analyses  were  conducted  for  each  criterion 
corresponding  to  the  10  ASVAB  area  composites.  This  approach  was 
taken  so  that  PSFs  would  be  available  for  any  MOS  regardless  of 
which  ASVAB  area  composite  is  used  as  a  selection  criteria  for 
that  KOS. 

Criteria- 

Separate  sets  of  regression  analyses  were  conducted  to 
predict  the  accuracy  and  time  measures  for  each  taxon.  Thus,  20 
regression  analyses  were  conducted  for  each  taxon  (10  ASVAB 
composites  times  2  types  of  performance  criteria.) 

To  predict  accuracy,  the  predictors  were  entered  in  three 
"blocks. *  In  the  first  block,  the  relevant  ASVAB  composite  was 
entered.  In  the  second  block,  of  the  training-related  variables 
(frequency,  recency,  and  frequency-recency  interaction  term)  were 
entered  into  the  equation.  In  the  third  block,  a  stepwise 
technique  was  used  to  determine  which  of  the  remaining  predictors 
would  enter  the  equation. 

To  predict  time,  the  predictors  were  entered  in  four  blocks. 
In  the  first  block,  the  ASVAB  composite  was  entered.  In  the 
second  block,  the  training  variables  were  entered.  In  the  third 
block,  the  accuracy  criterion  was  entered.  In  the  fourth  block,  a 
stepwise  technique  was  again  used  to  determine  which  of  the 
remaining  predictors  would  enter  the  equation.  Accuracy  was  used 
as  a  predictor  of  time  because  of  the  expected  relationship 


4?  -- 


Table  20 

Expected  Predictors  for  Each  Taxon 
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N/A 
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1  Tim*  measures  for  Visual  Raeognitlon/Dlecrtmlnetlon  and  Communication  •  Oral 
srara  not  available 

2  Training  measures  tor  Communication  •  Oral  warn  not  avatlabl# 
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between  time  and  accuracy.  In  PER-SEVAL,  we  intended  to  first 
predict  accuracy  and  then  predict  time  given  the  predicted 
accuracy  value. 

Results  From  Regression  Analyses  Without  Correction  Factors 

Table  21  summarizes  the  results  from  the  regression  analyses 
without  the  correction  factors.  In  doing  the  regression 
analyses  without  the  correction  factors,  predictors  were  forced 

into  the  equation  to  mirror  the  results  obtained  from  the  analyses 
with  the  correction  factors  (see  below) . 

Results  From  Regression  Analyses  With  Correction  Factors 

Regression  analyses  were  conducted  with  correction  factors 
for  restriction  of  range  due  to  the  use  of  ASVAB  scores  as  a 
selection  mechanism  for  entry  into  the  Army  and  individual  MOSs. 

.Correction  for  restriction  of  range. 

Entrance  into  the  Army  is  typically  restricted  to  individuals 
who  score  above  a  minimum  value  on  the  Armed  Forces  Qualification 
Test  (AFQT) .  The  AFQT  is  a  composite  of  four  ASVAB  subtests  — 
Arithmetic  Reasoning,  Word  Knowledge,  Paragraph  Comprehension,  and 
Numerical  Operations.  Once  an  individual  is  accepted  into  the 
Army,  he  or  she  is  assigned  to  an  MOS.  However,  entrance  into  the 
MOS  is  typically  restricted  to  individuals  who  score  above  a 
minimum  value  on  a  particular  ASVAB  area  composite.  The  ASVAB 
area  composites  are  also  composites  of  individual  ASVAB  subtests 
(Table  4  lists  the  subtests  in  each  composite) .  Thus,  restriction 
of  range  occurs  at  two  levels — entrance  into  the  Army  and  entrance 
into  the  MOS. 

The  procedure  used  to  correct  R  for  range  restriction  is  one 
proposed  by  Lawley  (1943)  and  described  in  Lord  and  Novick  (1968) . 
In  applying  the  procedure,  the  variance-covariance  matrix  of  the 
ASVAB  composites  for  the  1980  youth  population  was  computed  using 
the  variance-covariance  matrix  of  the  ASVAB  subtests  (Mitchell  and 
Hanser,  1980).  Table  22  lists  these  intercorrelations.  The  next 
step  in  the  correction  procedures  was  to  adjust  for  the  MOS 
selection  criteria  (i.e.,  the  ASVAB  composites).  The  variances 
and  covariances  for  the  ASVAB  composites  for  each  Project  A  MOS 
used  in  the  analyses  are  listed  in  Appendix  D. 


Mathematical  description  of  correction  procedures. 

In  describing  the  equations  for  correcting  for  restriction  of 
range  or  curtailment,  we  use  the  following  notation: 
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Table  21 
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Table  22 


Mean,  Standard  Deviations  and  intercorreiations  for  Population  Taking  ASVAB: 
1980  Reference  Population  Subtest  Scores8 


ASVAB  SubtMt  (N  *  9173) 


Arithmetic 

Rationing 

AR 

Word 

Knowladgt 

WK 

Paragraph 

Comprahanslon 

PC 

Numerical 

Operations 

NO 

Oanaral 

Sclaneo 

GS 

Coding 

Spoad 

CS 

Auto  A  Shop 
Information 
AS 

Mathematics 

Knowledge 

MK 

Maohanloal 

Comprehension 

MC 

Electronics 

Information 

El 

AR 

SO. !3b 

■ 

10.25 

WK 

.71 

50. 11 
10.05 

Hi 

PC 

.67 

.80 

51.47 

Ml 

NO 

.63 

.60 

.60 

I 

GS 

.72 

.80 

.69 

— 

4t.*l 
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CS 

.61 

.55 

.56 
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.45 

51.94 

10.10 

AS 

.53 

.52 

.42 

.29 

.64 

43.21 

3.12 

MK 

.83 

.67 

.64 

.62 

.69 

.41 

91.94 

10.77 

MC 

.68 

.59 

.52 

.40 

.70 

.33 

.74 

47.55 

El 

.66 

.68 

.57 

.41 

.76 

.34 

.75 

mm 

.74 

47.33 

3.33 

AR  •  Arithmetic  Reasoning 
WK  *  Word  Knowledge 
PC  ■  Paragraph  Comprehension 
NO  ■  Numerical  Operations 
OS  •  General  Science 


CS  ■  Coding  Speed 
AS  a  Auto  and  Shop  Information 
MK  a  Mathematics  Knowledge 
MC  a  Mechanical  Comprehension 
El  a  Electronics  Information 


Reatrlcted  to  persona  In  the  sample  bom  between  January  1,  1957  and  December  31,  1902  (10  through  23  years  at 
time  of  testing,  July»October  1900). 

b  Means  and  Standard  Deviations  along  the  diagonal.  Means  are  slightly  above  the  diagonal,  and  standard 
deviations  are  slightly  balow. 


REFERENCE: 

Office  of  the  Assistant  Secretary  of  Defense  (OASD)  (Manpower,  Reserve  Affairs,  and  Logistics].  (1982).  Profile  of 
American  Youth:  19 an  Haflnnwlrta  Administration,  fll  the  Armari  flaruliiaa  Unpannnal  ApHturta  Biliary 
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x  (X)  -  Variables  on  which  explicit  selection  has 

taken  place  (corresponding  variables  in  the 
uncurtailed  population) 

y(Y)  -  Variables  on  which  incidental  selection  has 
taken  place  (corresponding  variables  in  the 
uncurtailed  population) 

Sx(SX)  -Variance  covariance  matrix  of  the  variables  on  which 
explicit  selection  has  taken  place 

Sy(SY)  -Variance  covariance  matrix  of  the  variables  on  which 
incidental  selection  has  taken  place 


We  make  the  following  assumptions  (Lawley,  1943;  Lord  and  Novick, 
1968)  : 

(i)  E  (Y  |  X)  =  E  (y  |  x) 

(ii)  SY.X  =  Sy.x 

The  first  assumption  is  that  the  regression  equations  and,  hence, 
the  regression  coefficients,  are  equal  in  the  curtailed  and  the 
uncurtailed  populations.  Since  the  regression  coefficients  are 
given  by  the  expression  B  =  SX-1  SXY  =  Sx-1  Sxy,  it  follows  that; 

SXY  -  SX  Sx-1  Sxy 

The  residual,  a  partial  variance-covariance  matrix  Sy.x  is  given 
by  the  expression; 

Sy.x  -  SY  -  SYX  SX-1  SXY 


Similarly, 


Sy.x  «  Sy  -  Syx  Sx-1  Sxy 


Thus, 


and, 


or. 


SY  -  S’XY  SX-1  SXY  =  Sy  -  S'xy  Sx-1  Sxy 

hence, 

SY  -  Sy  +  S'XY  SX-1  SXY  -S’xy  Sx-1  Sxy 

Sy  -  Sy  +  (S’XY  -  S’xy)  Sx-1  Sxy 
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when  selection  takes  place,  SX,  Sx,  Sxy,  and  Sy  are  known. 
Correcting  for  curtailment  requires  obtaining  SY,  and  SXY  so  that 
the  variance-covariance  matrix  of  Y  and  X  in  the  uncurtailed 
population  can  be  obtained.  Once  this  matrix  is  determined,  the 
equation  for  predicting  Y  from  X  in  the  uncurtailed  population  can 
be  determined. 

In  the  present  context,  there  are  two  possible  definitions  of 
the  uncurtailed  population:  (a)  the  1980  reference  population  and 
(b)  the  population  of  those  selected  to  enter  the  Army.  The 
equations  given  above  can  be  used  to  correct  for  restriction  of 
range  for  these  two  populations . 

Since  the  1980  reference  population  data  only  includes 
information  on  the  relationships  among  subtests  (i.e.,  standard 
deviations  and  means) ,  it  was  necessary  to  estimate  the 
relationships  among  the  ASVAB  composites  for  this  same  population. 
In  making  these  estimates,  we  assumed  that  the  composites  were 
linear  composites  of  the  subtests.  In  actuality,  the  composite 
scores  are  derived  from  the  subtests  using  equipercentile-equating 
techniques.  These  techniques  involve  using  conversion  tables  that 
give  slightly  nonlinear  translations  of  the  "sum-of-subtest- 
standard"  scores . 
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Results  per  Taxon 


Results  for  the  regression  analyses  of  time  and  accuracy  for 
each  taxon  are  provided  in  the  subsections  that  follow. 

Visual  recognition/discrimination. 

Table  23  presents  the  regression  analyses  results  for  the 
accuracy  measure.  Note  that  time  measures  were  not  available  in 
the  Project  A  data  base  for  this  taxon. 


Summary  of  Regression  Analyses  (with  Corrections)  for  Visual  Recognition/Discrimination:  Accuracy 
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Cognitive  -  numerical. 

Table  24  and  25  present  the  regression  analyses  results  for 
the  accuracy  and  time  measures,  respectively. 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Cognitive  -  Numerical  Analysis:  Accuracv 


57 


Summary  of  Regression  Analyses  (with  Corrections)  for  Cognitive  -  Numerical  Analysis:  Time 


Cognitive  -  information  procesaing/nroblem  solving. 

Table  26  and  27  present  the  regression  analyses  results  for 
the  accuracy  and  time  measures,  respectively. 


Summary  of  Regression  Analyses  (with  Corrections)  for  Cognitive  -  Information  Processing/Problem 
Solving:  Accuracy 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Cognitive  -  Information  Processing/Problem 
Solving:  Time 
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F-ing  motor  -  discrete. 

Table  28  and  29  present  the  regression  analyses  results  for 
the  accuracy  and  time  measures,  respectively. 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Fine  Motor  *  Discrete:  Time 
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Gross  motor  -  light. 


Table  30  presents  the  regression  analyses  results  for  the 
accuracy  measure.  Note  that  time  measures  were  not  available  in 
the  Project  A  data  base  for  this  taxon. 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Gross  Motor  -  tight:  Accurac 
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Table  31  and  32  present  the  regression  analyses  results  for 
the  accuracy  and  time  measures,  respectively. 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Communication  -  Oral:  Accuracy 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Communication  -  Oral:  Time 


69 


Table  33  and  34  present  the  regression  analyses  results  for 
the  accuracy  and  time  measures,  respectively. 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Communication  -  Reading  and  Writing:  Accuracy 
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Summary  of  Regression  Analyses  (with  Corrections)  for  Communication  -  Reading  and  Writing:  Time 
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Summary,  a £  i&x>dtjs.  • 


Table  35  summarizes  the  results  from  the  regression  analyses 
with  the  correction  factors.  Tables  36  and  37  provide  comparisons 
with  the  regression  analyses  which  were  done  without  the 
correction  factors  for  time  and  accuracy,  respectively. 
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Description  of  How  the  PSFs  Will  Be  Used 


Figure  4  provides  an  overview  of  how  the  PSFs  will  be  applied 
in  PER-SEVAL.  In  the  initial  steps  of  a  PER-SEVAL  application, 
users  provide  the  input  information  needed  to  apply  a  PSF.  To  do 
this,  they  first  assign  the  duty  positions  associated  with  a  new 
weapon  system  to  an  MOS.  These  duty  positions  were  constructed  as 
part  of  the  MAN-SEVAL  application.  As  part  of  this  process  a  user 
may  identify  a  new  MOS.  Once  an  MOS  has  been  identified,  the 
system  will  identify  an  ASVAB  composite  for  that  MOS  and  expected 
cut-off  and  mean  levels  for  that  composite.  The  user  is  then 
asked  to  assign  each  operator  and  maintainer  task  to  one  or  more 
of  the  MPT2  taxons  using  the  taxon  definitions  provided  in  Appendix 
A  as  a  guide.  Each  task  can  be  assigned  to  a  maximum  of  three 
taxons.  Users  will  also  estimate  the  expected  percentage  of  task 
elements  involving  each  taxon. 

In  the  next  step  of  a  PER-SEVAL  application,  the  user 
describes  how  frequently  the  task  will  be  performed  on  the  job. 

The  system  then  converts  this  information  into  estimates  of 
frequency  and  recency  of  performance.  (The  PER-SEVAL  design 
specifications  describe  this  conversion  process  in  detail.)  In  a 
later  PER-SEVAL  step,  the  system  will  ask  a  series  of  questions 
that  are  designed  to  elicit  from  users  the  minimum  information 
needed  to  estimate  the  mean  level  of  performance  that  can  be 
expected  given  (a)  a  particular  contractor's  hardware/software 
design  and  (b)  the  expected  quality  of  the  population  who  will 
perform  the  task  (i.e.,  the  level  of  the  relevant  ASVAB  area 
composite) .  Page  81  outlines  the  process  that  will  be  employed 
to  obtain  these  mean  values . 

Once  the  taxon  assignments  have  been  made  and  the  mean 
performance  values  have  been  obtained,  PER-SEVAL  begins  the 
process  of  identifying  the  minimum  level  of  the  ASVAB  area 
composite  that  will  provide  the  desired  performance  level — that  is 
the  level  that  will  meet  the  performance  requirements  identified 
by  SPARC,  one  of  the  other  MANPRINT  aids.  There  are  two 
components  to  these  performance  requirements — a  standard  which 
describes  the  quantitative  level  of  performance  that  must  be 
achieved  and  a  criterion  that  describes  the  percentage  of  time 
that  level  must  be  achieved.  PER-SEVAL  identifies  the  minimum 
ASVAB  area  composite  by  iteratively  changing  the  composite  score, 
calculating  the  impact  of  this  change  on  other  personnel 
characteristics,  and.  then  using  the  PSF  to  estimate  expected  task 
performance  at  the  new  predictor  levels. 

The  next  section  provides  several  examples  of  how  the  PSFs 
will  be  applied  once  taxon  assignments,  mean  performance  levels, 
and  revised  predictor  values  have  been  determined.  In  subsequent 
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Figure  4.  Overview  of  PSF  application. 


sections,  procedures  for  estimating  the  mean  performance  levels 
and  revised  predictor  values  are  outlined. 

Example  of  PSF  Application 

In  this  section,  we  present  an  example  of  how  the  PSFs  will 
be  used  to  predict  task  performance.  The  example  employs  data  from 
the  Project  A  data  base.  The  task  used  in  this  example  is  "Start 
and  Stop  a  Tank . " 

The  PSFs  are  applied  in  a  three  step  process.  First,  the  raw 
score  for  the  predictor  variables  are  converted  to  standardized 
scores.  Second,  a  standardized  criterion  score  is  predicted  by 
multiplying  each  standardized  predictor  by  its  beta  weight  (from 
the  PSFs)  and  summing  the  result.  Third,  the  standardized 
criterion  is  converted  to  a  raw  score.  Note  that  the  mean 
criterion  value  used  in  this  conversion  is  supplied  by  the  user. 
Table  38  displays  the  results  of  each  of  these  steps  for  the 
example  task. 

Predictions  for  task  time  will  be  calculated  in  a  similar 
manner  except  that  task  accuracy  will  be  included  as  a  predictor 
variable.  Thus,  the  accuracy  score  for  a  particular  task  is 
predicted  prior  to  the  time  score  for  that  task. 

In  some  cases,  a  single  task  may  be  assigned  to  several 
taxons.  In  these  cases,  predictions  are  made  for  each  taxon  and  a 
weighted  average  is  calculated,  weighing  each  taxon  prediction  by 
the  percentage  value  assigned  that  taxon  by  the  user. 

Assumptions  in  Applying  PSFs 

A  number  of  assumptions  underlie  application  of  the  PSF  in 
the  manner  described  above.  The  key  assumptions  are  as  follows: 

1)  The  PSFs  we  have  developed  for  a  taxon  can  be  applied  to 
any  task  which  is  placed  in  that  taxon; 

2)  The  same  predictor-criterion  relationships  apply  over 
different  levels  of  the  predictors  and  the  performance 
measure; 

3)  Predictor-Criterion  relationships  do  not  vary  as  a 
function  of  other  personnel  characteristics  or  other 
variables; 

4)  Users  can  reliably  assign  the  tasks  to  taxons  and  provide 
the  information  needed  to  estimate  mean  performance  levels; 
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71.7  =  PREDICTED  CRITERION  SCORE 


5)  The  corrections  for  restrictions  of  range  are  based  on 

the  following  statistical  assumptions. 

The  two  sets  of  prediction  equations  relating  the  performance 
of  a  task  in  a  given  taxon  to  the  scores  on  the  predictor 
variables  were  developed  using  (a)  the  reference  population,  and 
(b)  the  population  of  those  selected  for  an  MOS.  In  developing 
these  equations  it  was  assumed  that; 

(i)  E  (Y  |  X)  =  E  (y  |  x) 

where  Y  is  the  criterion  score  in  the  unselected  population  (a)  or 
(b)  and  y  is  the  corresponding  score  for  those  who  have  been 
selected  into  a  MOS.  Similarly  X  is  the  predictor  score  in  the 
unselected  population  (a)  or  (b)  and  x  is  the  predictor  score  for 
those  selected  into  a  MOS. 

The  second  assumption  is : 

(ii)  CT2YIX  =  CT2y|x 

i.e.,  the  variance  of  Y  partialling  out  the  effect  of  X  in  the 
unselected  population  is  the  same  as  the  variance  of  y  partialling 
out  the  effect  of  x  in  the  population  selected  into  a  MOS. 

These  two  assumptions  are  given  in  terms  of  a  single 
criterion  variable  and  a  single  predictor  variable.  These 
immediately  generalize  to  the  multivariate  case  and  provide  the 
basis  for  correcting  for  restriction  of  range. 

Methods  far  ,  £llciLiasiJteaa..£fit£oxiiiancg  Values 

In  estimating  mean  task  performance  within  the  framework 
described  here,  there  are  three  factors  that  must  be  considered — 
the  difficulty  of  the  task  as  determined  by  the  hardware/software 
design,  the  overall  capabilities  of  the  population  performing  the 
task,  and  the  sustainment  training  opportunities  provided  to  this 
population  (i.e.,  frequency  and  recency  of  task  performance). 
Within  the  PER-SEVAL  framework,  we  assume  that  the  "overall 
capabilities  of  the  population"  are  primarily  determined  by  one 
type  of  personnel  characteristic — the  ASVAB  area  composite  used  to 
control  entry  into  the  MOS.  We  assume  that  the  distribution  of  the 
other  personnel  characteristics  (e.g.,  the  new  Project  A 
predictors)  are  determined  by  the  cut-off  level  selected  for  the 
ASVAB  area  composite.  Hence,  when  identifying  a  reference 
population  to  make  the  mean  judgement,  the  user  has  to  consider 
only  one  personnel  characteristic — ASVAB  area  composite. 

Despite  this  simplification,  making  a  direct  judgement  of  the 
mean  taking  into  account  these  three  factors  is  a  complex  process. 
The  PER-SEVAL  program  is  designed  to  minimize  the  complexity  of 
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this  process.  There  are  three  situations  under  which  the  mean 
values  could  be  obtained  (see  Figure  5) . 

First,  because  PER-SEVAL  is  designed  to  be  applied  later  in 
the  acquisition  process,  it  is  possible  that  performance  data  will 
be  available  for  the  task  from  test  and  evaluation.  As  part  of 
the  test  and  evaluation,  data  could  be  collected  on  mean  task  time 
and  accuracy,  the  mean  and  standard  deviation  of  the  ASVAB  area 
composite  of  the  soldiers  performing  the  task,  and  the  training 
frequency  and  recency  prior  to  task  performance.  This  information 
is  all  that  is  needed  to  derive  the  necessary  inputs  for  the  PSFs 
(see  Figure  5) . 

In  the  second  and  third  situations,  we  assume  that  empirical 
data  on  task  performance  is  not  available.  In  the  second 
situation,  we  assume  that  the  task  whose  performance  we  are 
attempting  to  predict  is  measured  on  the  same  scale  as  the  Project 
A  tasks  (i.e.,  percent  steps  correct) .  In  this  situation,  the 
system  first  estimates  scores  for  all  personnel  characteristics 
other  than  ASVAB  area  composite  (scores  for  the  composite  were 
identified  in  an  earlier  step) .  Information  on  the  existing  or 
projected  distribution  of  the  other  personnel  characteristics  at 
various  levels  of  the  ASVAB  area  composite  will  be  available  in 
the  PER-SEVAL  files.  (The  projected  distributions  would  be 
predicted  by  P-CON.)  This  information  can  be  used  to  generate 
expected  mean  scores  for  the  non-ASVAB  characteristics  at  a  given 
cut-off  level  of  the  ASVAB  composite.  The  user  next  rates  the 
expected  mean  level  of  performance  using  a  behaviorally-anchored 
rating  scale  (see  Figure  6) .  The  anchors  on  this  scale  would 
depict  expected  performance  levels  for  Project  A  tasks  falling 
into  that  taxon.  These  levels  would  be  predicted  using  the  PSFs 
and  the  predictor  values  described  above  as  input.  It  should  be 
noted  that  this  scale  should  be  appropriate  for  most  fine  motor- 
discrete  tasks  since  "%  steps  correct*'  is  the  metric  most  often 
used  to  measure  performance  on  these  tasks.  Based  on  previous 
analyses,  we  expect  30  to  60  percent  of  weapon  systems  tasks  fall 
into  the  fine  motor-discrete  taxon.  It  should  also  be  noted  that 
as  PER-SEVAL  is  applied  to  a  large  number  of  weapon  systems,  it 
will  be  possible  to  build  task  difficulty  rating  scales  using 
metrics  other  than  the  Project  A  "%  steps  correct"  metric.  Once 
the  user  has  input  the  mean  values,  he  is  then  asked  to  enter  the 
expected  minimum  (5th  percentile)  and  maximum  (95th  percentile) 
values  for  task  performance.  This  information  is  used  to  generate 
a  standard  deviation  for  the  task. 

In  the  third  situation,  we  assume  that  the  new  task  is  not 
measured  on  the  same  scale  as  the  Project  A  tasks  (i.e.,  not 
measured  on  the  %  steps  correct  metric) .  In  these  situations,  the 
user  follows  procedures  similar  to  those  described  above  (see 
Figure  5) .  However,  rather  than  using  the  BARS  scales,  the  user 
makes  direct  estimates  of  mean  performance  given  a  mean  ASVAB  area 
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composite  level  and  expected  frequency  of  performance  on  the  job. 
For  assistance,  a  user  can  ask  the  system  to  show  what  level  of 
performance  was  achieved  on  other  tasks  falling  into  that  taxon 
given  the  same  levels  of  ASVAB  area  composite  and  frequency  of 
performance.  As  in  the  second  situation,  the  user  is  asked  to 
enter  the  expected  minimum  (5th  percentile)  and  maximum  (95th 
percentile)  values  for  the  task  to  provide  the  information  needed 
to  estimate  the  standard  deviation  for  task  performance. 
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Figure  5.  Methods  for  eliciting  mean  performance  values. 


TASK:  Start  M1A1  Tank  Engine 


MOS:  12.E 


TASK  TYPE:  Fine  Motor  -  Discrete  EXPECTED  SCORE:  Ml 

ASVAB  COMPOSITE:  Combat  fCO) 

EXPECTED  FREQUENCY  OF  PERFORMANCE  ON  THE  JOB:  Once  a  Month 

Estimate  expected  %  steps  correct  for  task  listed  above.  Examples  of 
performance  levels  for  other  Fine  Motor  -  Discrete  tasks  are  listed  below 
to  assist  you. 
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•  Perform  Operator  Maintenance  on  M3A1  Machine  Gun  (95%) 

•  Operate  Radio  Set  AN7URC-64  (84%) 

•  Put  on  M25A1  Protective  Mask  with  Hood  (75%) 

-  Stari/Stop  Engine  (on  M485/M60)  (68%) 

-  Set  HeadspaceSTimlng  on  M2  (55%) 


Figure  6.  Format  ter  behavioraiiy  anchored  rating  scaie. 
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Potential  Techniques  for  Validating  the  PSFs  and  Associated 

Concepts 


As  noted  in  the  introduction,  resource  limitations  prohibited 
us  from  validating  the  PSFs  and  associated  concepts.  In  this 
section,  we  briefly  outline  key  concepts  related  to  PSF 
application  that  should  be  validated  and  possible  validation 
techniques . 

To  "validate"  the  PSF  concepts  outlined  in  this  paper,  there 
are  four  key  questions  that  must  be  answered. 

1)  Can  users  make  reliable  taxon  assignments? 

2)  Can  users  make  reliable  and  valid  estimates  of  mean 
performance? 

3)  Do  the  PSFs  accurately  predict  task  performance?  If 
partially  successful,  under  what  circumstances  are  they 
successful? 

4)  Is  the  PER-SEVAL  task  taxonomy  an  accurate  representation 
of  soldier  tasks? 

5)  What  is  the  impact  of  task  performance  reliability  on  the 
PER-SEVAL  estimates? 

Question  13  is,  of  course,  the  most  critical  and  the  ultimate 
validation  question  in  a  psychometric  sense.  Furthermore,  we 
would  argue  that  if  the  answer  to  the  first  three  questions  is 
yes,  we  would  not  need  to  know  the  answer  to  the  fourth  question 
since  the  ultimate  value  of  a  taxonomy  is  determined  by  its 
utility  in  predicting  performance. 

Techniques  for  Measuring  the  ..Reliability  of  Taxon  Assignments 

The  reliability  of  the  PER-SEVAL  taxon  assignment  process  can 
be  tested  as  follows.  A  group  of  Army  personnel  from  the  same 
population  as  the  expected  PER-SEVAL  users  can  be  asked  to  make 
taxon  assignments  for  a  large  number  of  Army  tasks  using  the 
portion  of:  PER-SEVAL  that  assists  users  in  making  these  judgments. 
These  users  would  be  asked  to  assign  the  same  set  of  tasks.  Two 
measures  of  the  "agreement"  of  task  taxon  assignment  could  then  be 
constructed.  One  measure  would  assess  the  percentage  of  time  a 
task  is  placed  into  the  same  taxon.  {The  actual  measure  to  be 
used  would  be  a  coefficient  of  inter-rater  reliability.)  The 
other  measure  would  examine  the  reliability  of  the  taxon 
percentage  assignments.  It  would  be  constructed  by  correlating 
taxon  percentage  scores  for  tasks  assigned  to  the  same  taxon. 
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If,  as  a  result  of  the  above  analyses,  it  is  found  that  users 
are  confusing  two  taxons,  improved  techniques  for  describing  these 
taxons  should  be  developed  and  re-tested.  If  such  techniques  are 
not  possible,  the  taxons  should  be  merged  or  rearranged. 

Techniques  for  Measuring  the  Reliability  and  Validity  of  the  Mean 
Performance  Estimates 

Reliability  assessment. 

The  reliability  of  the  PER-SEVAL  mean  performance  estimation 
process  can  be  tested  as  follows .  A  group  of  Army  personnel  from 
the  same  population  as  the  expected  PER-SEVAL  users  can  be  asked 
to  make  mean  performance  estimates  for  a  large  number  of  Army 
tasks  using  the  portion  of  PER-SEVAL  that  assists  users  in  making 
these  judgments.  Users  would  be  asked  to  make  estimates  for  the 
same  set  of  tasks.  Correlations  between  the  task  estimates  could 
then  be  examined. 

Stolidity  .^aaaftsameat  ♦ 

The  validity  of  the  mean  estimates  could  be  assessed  by 
comparing  the  estimated  mean  performance  estimates  with  actual 
values  from  empirical  data.  To  do  this,  tasks  with  existing 
empirical  data  would  have  to  be  compared  with  task  performance 
estimates  generated  by  the  procedures  described  above. 

Isckniquas..  Iqz.  .Validatiag.  &SE.  EeLlosmaftcs  E-tedlation. 

The  PSfs  can  be  used  to  make  performance  predictions  for  a 
sample  of  individual  soldiers  on  a  number  of  tasks  within  a  taxon. 
These  predictions  can  be  correlated  with  actual  performance  on  the 
tasks.  Validation  of  this  type  could  readily  be  made  using  data 
from  the  Project  A  data  base.  To  do  this,  one  would  attempt  to 
predict  performance  on  tasks  that  were  not  included  in  the 
original  PSF  development  effort. 

Ifltp.dc.t-..Q£_Task..£.ai£,aimanca,  RaHahHim.  sa  gSftrSSVAL.  Estimates 

The  reliability  of  hands-on  performance  tests  for  individual 
tasks  is  relatively  low.  For  example,  for  the  Project  A  hands-on 
performance  measures,  Campell,  Campeil,  Rumsey,  and  Edwards  (1995) 
report  split-half  reliabilities  for  individual  tasks  that  range 
from  .35  to  .82  across  MOSs.  Currently  PER-SEVAL  produces  point 
estimation  of  performance  for  individual  tasks  that  assume  perfect 
reliability.  Ideally,  if  information  on  the  reliability  of  task 
performance  measures  for  new  systems  was  available,  these  point 
estimates  could  be  converted  to  interval  estimates  that  would 
reflect  the  measures'  reliability.  Modification  of  PER-SEVAL  to 
accommodate  changes  in  task  performance  reliability  should  be 
considered  in  future  HARDMAN  III  improvement  programs. 
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Potential  Techniques  for  Improving  the  PSFs 


In  addition  to  the  validation  program  described  on  page  87, 
there  are  several  other  studies  that  could  be  undertaken  to 
improve  the  PSFs.  As  the  discussion  on  page  21  and  47  indicates, 
at  this  time  we  were  not  able  to  develop  PSFs  for  several  types  of 
tasks.  There  were  several  reasons  for  this.  First,  the  Project  A 
data  base  lacked  data  on  several  different  task  types  related  to 
system  performance.  In  particular,  the  Project  A  data  base 
contains  one  fine  motor-continuous  task  and  only  a  few  visual 
recognition/discrimination  tasks.  Second,  for  some  task  types, 
particularly  those  with  a  small  number  of  tasks,  the  predictor- 
performance  relationships  were  weak  (see  Table  39) .  Third,  for 
all  but  a  handful  of  tasks  the  performance  measure  used  in  Project 
A  is  "%  go" — that  is,  the  number  of  steps  in  a  task  of  which  the 
soldier  got  a  "go, "  divided  by  the  total  number  of  steps  in  a 
task.  While  this  measure  is  directly  relevant  to  fine  motor- 
discrete  tasks,  it  is  less  relevant  to  other  types  of  tasks  such 
as  fine  motor-continuous  tasks.  For  example,  performance  measures 
more  relevant  to  fine  motor-continuous  tasks  are  "percent  hits" 
(for  shooting),  root  mean  square  deviation  from  idoal  flight  path 
(for  piloting)  .  Measures  of  this  type  typically  car.  only  oe 
collected  in  the  actual  vehicles  or  in  simulators.  Because  its 
primary  focus  was  job  performance  and  not  weapon  system 
performance,  Project  A  focused  its  hands-on  assessments  to  tasks 
at  the  soldier's  home  base. 

In  future  efforts,  we  recommend  that  ARI  develop  more 
performance  shaping  functions  by  collecting  additional  empirical 
data  from  man- in-the- loop  simulations  at  Army  simulation 
facilities.  These  additional  functions  would  be  designed  to 
provide  data  on  the  task  types  not  covered  adequately  in  the 
Project  A  data  base.  They  could  also  be  designed  to  provide  data 
on  the  relationship  between  performance  and  key  training  variables 
not  included  in  the  current  PEP-SEVAL.  For  example,  PER-SEVAL 
estimates  training  as  a  function  of  the  frequency  and  recency  of 
performing  the  task  on  the  job  or  in  sustainment  training  (these 
are  the  training  variables  most  related  to  training  on  the  job  and 
the  only  training  variables  available  in  the  Project  A  data  base) . 
Other  key  training  variables  (type  and  amount  of  institutional 
training)  are  not  included  in  the  PER-SEVAL. 

We  believe  that  there  are  a  number  of  simulators  which  could 
provide  the  type  of  data  needed  by  the  PER-SEVAL  performance 
shaping  functions.  One  such  simulator  is  the  Realistic  Air 
Defense  Engagement  System  (RADES) .  RADES  is  an  air  defense 
simulator  consisting  of  subscale  aircraft,  an  aircraft 
position/location  system,  actual  air  defense  weapon  systems 
(e.g..  Chaparral,  Improved  Chaparral,  Self-Propelled  Vulcan, 
Reueye,  Stinger,  Rolhnd,  and  HIVAD) ,  and  an  electronic  interface 
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which  connects  the  weapon  to  sophisticated  data  collection  and 
communication  systems .  Performance  measures  which  RADES  can 
assess  include  times  and  ranges  for  critical  engagement  events, 
aircraft  identification  accuracy,  and  kill  or  miss  data. 

Other  simulators  which  could  provide  data  for  PER-SEVAL 
performance  shaping  functions  include  the  Crew  Station  R&D 
Facility  currently  under  development  by  the  Army  Aeroflight 
Dynamics  Directorate  and  the  AMC  ARTI  program  and  the 
developmental  SIMNET  (SIMNET-D)  system  at  Fort  Knox.  The 
September/October  1988  MANPRINT  Bulletin  described  how  SIMNET-D 
could  be  used  to  support  MANPRINT  efforts. 

Collection  of  empirical  data  from  the  simulators  will  be  a 
time  consuming  process.  However,  the  PER-SEVAL  provides  a 
"theoretical"  framework  which  will  allow  this  data  to  be 
generalized  to  a  wide  range  of  future  systems  and  tasks  —  thus 
the  payoff  will  be  high. 

Within  recent  years,  there  has  been  renewed  academic  interest 
in  examining  the  factors  which  moderate  or  impact  the  relationship 
between  human  abilities  and  task  performance.  For  example,  in 
recent  years  uhere  have  been  several  studies  on  the  relationship 
between  human  abilities  and  skill  acquisition  (see,  for  example, 
Ackerman-  1987;  Adams,  1987;  Henry  &  Hulin,  1987;  Schmidt,  Hunter 
Outerbridge,  Goff,  1988  and  Ortega,  1989)  .  These  studies 
indicate  that  the  relationship  between  performance  and  ability 
varies  as  function  of  type  of  ability,  place  in  the  skill 
acquisition  process,  and  level  of  task  difficulty.  Almost  all  of 
these  studies  used  ability  measures  that  are  not  used  by  the  Army. 
Thus,  it  is  difficult  to  generalize  their  findings  to  Army 
personnel.  One  possible  activity  under  the  proposed  task  order 
would  be  to  replicate  selected  academic  studies  using  Army  ability 
measures  (e.g.,  ASVAJB,  Project  A  predictors).  Results  from  such 
studies  could  lead  to  more  accurate  predictions  of  soldier 
performance . 
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Project  A  Teaks,  Taxon*.  Weights,  and  Descriptions 


APPENDIX  B.  Personnel  Characteristics  in 
Project  A  Data  Base 


INCLUDED 

AS 

PROJECT  A  PERSONNEL  REASON  FOR 

CODE  TITLE  CHARACTERISTIC  EXCLUSION 


A1AS80AR  Naw  1940  Stdz  ASVAB  Subtest  -  AR  No  Pari  of  Araa  Compoalte 

A1AS80AS  New  1980  Stdz  ASVAB  8uMest  •  AS  No  Part  of  Area  Composite 

A1AS80CS  Naw  1980  Stdz  ASVAB  Subtaat  •  CS  No  Part  of  Araa  Compoalta 

A1AS80EI  Naw  1980  Stdz  ASVAB  Subtaat  -  El  No  Part  of  Araa  Compoalta 

A1AS80OS  Naw  1980  Stdz  ASVAB  Subtaat  •  GS  No  Part  of  Araa  Compoalta 

A1AS80MC  Naw  1980  Stdz  ASVAB  Subtaat  -  MC  No  Pari  of  Araa  Compoalta 

A1AS80MK  Naw  1980  Stdz  ASVAB  Subtaat  -  MK  No  Part  of  Araa  Compoatta 

A1AS80NO  Naw  1980  Stdz  ASVAB  Subtaat  -  NO  No  Part  of  Araa  Compoatta 

A1AS80PC  Naw  1980  Stdz  ASVAB  Subtaat  -  PC  No  Part  of  Araa  Compoalta 

A1AS80VE  Naw  1980  Stdz  ASVAB  8ubtaat  •  VE  No  Part  of  Araa  Compoalta 

A1AS8GWK  Naw  1980  Stdz  ASVAB  Subtaat  -  WK  No  Part  of  Araa  Compoalta 


A1AC80CL  Naw  1980  Araa  Compoalta  -  CL  «Naw> 
A1AC80CO  Naw  1980  Araa  Compoalta  •  CO 

A1AC80EL  Now  1980  Araa  Compoalta  -  EL 

A1AC80FA  Now  1980  Araa  Compoatta  •  FA 

A1AC80GM  Naw  1980  Araa  Compoatta  •  QM 

A1AC80GT  Now  1980  Araa  Compoatta  •  OT 

A1AC80MM  New  1980  Araa  Compoette  -  MM 

A1AC80OF  Naw  1980  Araa  Compoalta  •  OF 

A1AC80SC  Naw  1980  Araa  Compoalta  -  SC  «New> 
A1AC808T  Naw  1080  Araa  Compoalta  <  ST 

A1AFQT80  Naw  1980  AFQT  Score 

A1MCAT80  Naw  1980  Marital  Category 

A1WQT  Weight 

At  HOT  Haight 

A1DIABLD  Otaatolte  Blood  Praaaura 

A1PULHE1  PULHES  Factor  •  Physical  Stamina 

AtPULHEJ  PULHES  Factor  •  Upper  Eztramttlaa 

A1PULH63  PULHES  Factor  •  Lower  Eztramttlaa 

A1PULHE4  PULHES  Factor  •  Hearing 

AtPULHEJ  PULHES  Factor  -  Eyee 

A1PULHE8  PULHES  Factor  -  Psychiatric 

A1PULHE7  PULHES  Factor  •  Ezp  WelghUitt 


Accaaalona  Cooatiucta: 

A1AQUANT  ASVAB  Construct:  Quafttttallva 

At ASPEED  ASVAB  Construct:  Speed 

AtATECH  ASVAB  Construct:  Technical 

A1AVERBL  ASVAB  Construct:  Verbal 

Cognitive  Testa: 

B3PSAONC  «  COMB:  Aasembtlng  Objects 
B3PBMPNC  8  CORN:  Map  Teat 

B3PBMZNC  •  CORR:  Maze  Teat 

83P30RNC  #  CORR:  Object  Rotation 

B3P30TNC  «  CORR:  Orientation  Teat 

B3PSRSNC  8  CORR:  Reason!!*  Teat 

Cognitive  Conetructa: 

B3PCORNT  Cognitive  Sub-Con  at  rod:  Spsi.  Orient. 
B3PCREAS  Cognitive  Suo-Conatroct:  Spatial  Raaa. 

S3PC6CAN  Cognitive  Sub -Construct:  Spatial  Scan. 

83PCSPAT  Cognitive  Construct:  Overall  Spatial 


Vat 

Yea 

Yas 

Yaa 

Yaa 

Yaa 

Yaa 

Yaa 

Yaa 

Yaa 

No  Redundant  with  Araa  Compoatta 

No  Redundant  with  Araa  Compoatta 

No  Included  In  Material  Handling  Models 

No  included  In  Malarial  Handling  Models 

No  Included  In  Malarial  Handling  Models 

No  Lack  of  Variability 

No  Lack  of  Variability 

No  Lack  of  Variability 

No  Lack  ot  Variability 

No  Lack  of  Variability 

No  Lack  el  Variability 

No  Only  Available  on  1/9  ot 


No  Redundant  wtth  Araa  Compoatta 

No  Redundant  wtth  Araa  Composite 

No  Redundant  with  Araa  Compoalta 

No  Redundant  wtth  Araa  Compoatta 


No  toe.  in  Compoatta  Meeeurea 

No  Inc.  !n  Compoatta  Measures 

No  Inc.  In  Compoalta  Measures 

No  Inc.  In  Compoalta  Measures 

No  Inc.  In  Compoatta  Measures 

No  Inc.  la  Compoatta  Measures 


No  Inc.  In  Compoalta  Meeeurea 

No  Inc.  In  Compoatta  Measures 

No  (ns.  la  Compoatta  Measures 

Yaa 


APPENDIX  B.  Personnel  Characteristics  in 
Project  A  Data  Base  (Corn.) 


INCLUDED 

AS 

PROJECT  A  PERSONNEL  REASON  FOR 

COCS  TITLE  CHARACTERISTIC  EXCLUSION 

Cho'o#  Ruction  Tmo: 

B3CSCRDT  CRT:  Mun  of  Trimmed  Daclalon  Tim*  No  Inc.  In  Compoalt*  Maaauru 

B3CSCRHT  CRT:  M*an  HI*  Rat*  No  Inc.  In  Compoalt#  Muauru 

Cannon  Shoot: 

B3CSC8TS  CS:  Moan  Aba.  Tim*  Dlacrap  No  Inc.  In  Jompoalt*  M*aaur*a 

Numbar  Memory: 

LSCSxMD  r  NUM:  M**n  for  Final  Raapona*  No  (nc.  In  Compoalt*  Maaauru 

B3CSNMHT  NUM:  M*an  H«  Rat*  No  Inc.  In  Compoalt*  Maaauru 

B3CSNUIN  NUM:  M*ati  tor  InHIal  Input  No  Inc.  In  Compoalt*  Maaauru 

B3CSNMOP  NUM:  Pooled  Mun  Operation  Tim*  No  Inc.  In  Compoalt*  Musuraa 

Perceptual  Speed  A  Accuracy: 

B3C8BSPT  PSV  ttain  of  Tr.mm*d  D*clalon  Tim*  No  Inc.  In  Compoalt*  Muauru 

B3CSPSHT  PSA:  Mun  Hit  Rat*  No  Inc.  In  Compoalt*  Maaauru 

Short-Tarm  Memory: 

BJCSSMDT  MEM:  Mun  of  Trimmed  DecUlon  Tim*  No  Inc.  In  Compoalt*  Muauru 

B3CS8MHT  MEM:  Mun  Hit  Rata  No  Inc.  In  Compoalt*  Muauru 

Simple  Reaction  Tim*: 

B3C36RDT  SRT:  Mean  of  Trimmed  Dulalon  Tire  No  Inc.  In  Compoalt*  Muauru 

B3CS8RHT  SRT:  Maan  Hit  Rat*  No  Inc.  In  Compoalt*  Muauru 

Target  Identification  Tut- 

•B3CSTIDT  TARGET:  Mun  of  Trimtmd  Dulalon  Tim*  »«*  1"  Compoalt*  Muauru 

83CSTIHT  TARGET:  Mean  Htt  Rata  No  Inc,  In  Compoalt*  Muauru 

Target  Shoot: 

B3C8TSDL  TARGET  SHOOT  •  Maan  Leg  (Diet  ♦  1)  No  Inc.  In  CompuH*  Maaaura* 

B3CSTSDT  TARGET  SHOOT  •  Mean  Tim*  to  Fir*  No  Inc.  In  Compoalt*  Maaauru 


Target  Tracking  f: 

B3CST1DL  TARGET  TRACKING  1  •  Maan  LoO  (DUl  *  1)  No  Ine.  In  Compoalt*  Maaauru 

Tergal  Tracking  2: 

83CST2DL  TARGET  TRACK  WG  2  -  Maan  Log  (Dial  ♦  1)  No  Inc.  In  Comport!#  Mauuru 

Total  Movamanl  Ttma: 

B3CSRTMT  Pooled  Mun  Movement  Tint#  No  Inc.  In  Compoalt*  Muauru 

Predictor  Computer  Conatructa: 

B3CCCPAC  Computer  Construct;  Complex  Parc  Asev  *## 

B3CCCP8P  Computer  Conahuet:  Complar  Parc  Spud 

B3CCNM8A  Computer  Construct:  Sum  Spud/Aoc. 

B3CCP8VM  Computer  Construct:  Paychomotor  Va# 

B3CCSRAC  Computer  Construct:  Simp.  Ruct.  Acc.  Vaa 

83CCSRSP  Computer  Con  at  met:  Simp.  RaacL  Spaed 
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Appendix  C:  Task  Taxonomy  Taxon  Descriptions 

I  Perceptual 

1.1  Visual  Pattern  Recoanition/Discrimination  —  Using  the  eyes 
to  identify  or  discriminate  targets  or  objects. 

Examples:  Identify  target;  identify  friend  or  foe,  conduct  day 
and  night  surveillance. 

NOTE:  Reading  text  or  numbers  is  covered  under  a  separate  task 
type  (see  4.1-READING/WRITING 

IX  Cognitive 

2 . 1  Numerical  —  performing  arithmetical  or  mathematical 
calculations . 

Examples:  Measure  an  azimuth  on  a  map  with  a  protractor,  estimate 
range,  determine  weight  and  balance  bearing. 

2.2  Reasonina/Problem  Solving/Decision  Making  —  encoding  or 
decoding  information;  classifying  objects  into  categories; 
troubleshooting  or  identifying  the  cause  or  source  of  an  existing 
problem  or  failure;  planning  or  developing  a  set  of  procedures  for 
performing  future  actions;  selecting  the  •’best"  course  of  action 
from  a  set  of  multiple  alternatives. 

Examples:  Encode/decode  messages.  Plan  flight.  Troubleshoot 
fuel  system  malfunction.  Troubleshoot  electrical  system 
malfunction.  Select  firing  position. 

UQXE:  A  task  which  involves  simple  reading  comprehension  should 
be  categorized  under  READING/WRITING  (4.1).  A  task  which  involves 
reading  material  and  then  performing  the  types  of  cognitive 
activities  described  above  (e.g.,  encoding  or  decoding)  should  be 
categorized  under  both. READING/WRITING  and  REASONING/PROBLEM 
SOLVING/DECISION  MAKING. 

NOTE:  Do  not  assign  a  task  to  the  REASONING/PROBLEM  SOLVING/ 
DECISION  MAKING  taxon  simply  because  it  has  heavy  memory 
requirements  (e.g.,  has  a  lot  of  steps).  Recalling  things  from 
memory  is  part  of  every  taxon. 

REASONING /PROBLEM  SOLVING/DECISION  MAKING  should  be  used  when  the 
user  is  required  to  perform  the  types  of  cognitive  activities 
described  above  (e.g.,  encoding  or  decoding)  with  the  material 
which  is  recalled  from  memory. 
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Ill  Motor 


3.1  Fine  ..Motor 

3.1.1  Fine  motor  discrete.  A  task  involving  a  set  of 
discrete  actions  performed  in  a  predetermined  sequence.  These 
actions  largely  involve  movement  of  the  hands,  arms,  or  feet  and 
require  little  physical  effort. 


Examples:  Prepare  a  DRAGON  for  firing;  Conduct  engine  shutdown; 
Assemble  SAW;  Put  On,  Wear,  Remove  M17  Protective  Mask;  Start  and 
Stop  a  Tank  Engine. 

3.1.2  Fine  motor  -  continuous.  Continuously  performing  the 
actions  needed  to  keep  a  system  on  a  specified  path  (e.g., 
piloting,  driving) ;  aiming  a  gun,  weapon  or  sensor  at  a  target 
either  by  pointing  the  weapon  directly  or  by  moving  a  cursor  or 
other  control  device;  aligning  two  objects  with  one  another  by 
continuously  moving  one  or  more  of  the  objects  until  they  are 
properly  aligned. 

Examples:  Drive  vehicle;  Land  aircraft;  Takeoff  aircraft; 
Aim/sight  rifle;  Adjust  rifle  fire. 

1*1 _ SEQaa-MQtox 

3.2.1  Gross  motor  -  heavy.  Actions  involving  extensive 
physical  effort  or  exertion. 

3. 2. 1.1  .caxcy-iiia/laad-iaBariiig .  Lifting  an  object, 
moving  it  from  one  point  to  another,  and  lowering  it. 
Example:  Load  ammunition  onto  howitzer. 

3. 2. 1.2  Lilting/, lQM&rlag .  Lifting  and/or  lowering 
an  object  and  unloading  or  releasing  it.  Example:  Load 
cannon . 


3. 2. 1.3  Torquing/pulllng .  Using  a  wrench  or  other 
tool  to  tighten  or  loosen  a  screw,  bolt,  or  other 
fastener.  Example:  Adjust  tire  lugs. 

3.2.2  Gross  motor  light.  Actions  involving  movement  of  the 
entire  body  which  do  not  require  extensive  physical  effort. 

Examples:  Evacuate  tank.  Get  into  firing  position  (for  using  an 
Ml 6  rifle) .  Engage  enemy  target  with  hand  grenade. 
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4.1  Reading/Writing  —  Reading  text  or  numbers  off  a  hard-copy  or 
CRT;  writing  with  pen  or  pencil. 

Example:  Check  vehicle  record  form;  Prepare  a  requisition  for 
publications . 

NOTE :  Typing  tasks  involve  both  READING/WRITING  and  FINE  MOTOR 
DISCRETE. 

NOTE :  If  the  soldier  must  read  a  technical  manual  during 
performance  of  task,  at  least  a  part  of  the  task  should  be 
assigned  to  the  READING/WRITING  category. 

4.2  Oral  Communication  —  Talking  or  listening  to  another  person. 


4.2.1  Face-to-face  communication.  Talking  or  listening  to 
another  person  who  is  physically  present.  Example:  Issue  Order; 
Use  Challenge  and  Password. 

4.2.2  Radio /telephone  communication.  Talking  or  listening 
to  another  person  over  a  radio,  intercom,  or  other  electronic 
medium.  Example:  Transmit/receive  messages;  Call  for  indirect 
fire . 
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APPENDIX  D 


Variance/Covariance  Matrices  for  MOSs  Used  in 
Regression  Analyses 

K08  1  IS  -  Vitkin  Cell*  Vtritncei  and  CoTiriaace*  -  Tile  tad  Ac cnracy 
Visual  Pattern  Reco<nition/Di*criiination 
Cron  Rotor  Li<ht 


CL 

l  CO 

8L 

PA 

GR 

GT 

HR 

OP 

SC 

ST 

CPAC 

CL  » 

183.6m? 

CO 

132.87170 

152.88014 

8L 

170.98996 

137.73115 

186.16561 

PA 

157.6577? 

185.15131 

152.35839 

169.58280 

CM 

150.62897 

180.88750 

176.87298 

133.06396 

190.43895 

GT 

170.51478 

127.0061? 

158.50373 

138.51952 

181.38710 

171.76128 

NR 

108.10628 

129.11286 

131.31780 

118.88888 

196.9921? 

102.58831 

145.10725 

OP 

12U2002 

137.65197 

130.65668 

120.08366 

182.7581? 

122.961(8 

133.63321 

141.33(63 

SC 

153.81561 

150.89160 

158.80519 

139.58911 

165.04112 

153.48822 

138.79(4? 

147.(9286 

175.26999 

ST 

173.27338 

183.21302 

180.6666? 

158.95133 

178.35383 

162.29521 

138.(2(26 

197.50081 

171.2(356 

201.01(13 

CPAC 

76.58466 

69.92916 

71.7)778 

76.25265 

68.29198 

73.82623 

88.95716 

56.10939 

70.2)145 

74.87228 

930.35768 

CPSP 

35.08959 

52.33386 

39.53659 

51.25008 

91.87423 

30.97022 

96.(8517 

99.89733 

41.11725 

97.(7(57 

-129.81149 

SUSP 

16.39540 

18.88868 

13.8636? 

21.96179 

8.26219 

12.39780 

11.35229 

19.32079 

8.73834 

15.259)8 

-7.73550 

SRAC 

30.32781 

31.67826 

38.33158 

29.833(7 

39.30234 

28.81(56 

29.97(13 

28.39350 

36. 47380 

39.89811 

55.77347 

SPAT 

338.90571 

333.06918 

330.61999 

363.89531 

301.60713 

305.73753 

2(5.39156 

280.07109 

329.59915 

352.50299 

298.33094 

SGRLVL 

20.91313 

15.65599 

19.88235 

17.07585 

17.37011 

21.127(7 

12.(3(39 

15.10107 

18.89190 

19.9(37? 

8.95092 

PESQ1 

1.11201 

.59777 

.96(83 

,22939 

1. 37178 

1.233(6 

1.029(9 

I. 99199 

1.10909 

1.80355 

•1.08032 

R8CI 

•1.36886 

•1.15307 

-1.15616 

-.78212 

*1.8I89( 

•1.(3080 

-.90(35 

-1.32975 

•1. 17319 

-1.(4299 

-.2(481 

PBS  RICI 

•1.24523 

-1.82560 

-.88106 

-2.27209 

-.87690 

-.988(0 

-.20394 

-.20273 

-.30(5? 

-.193(8 

-5.15(97 

TA20VI 

2.89230 

2.32502 

2.78(86 

2.92683 

2.723(5 

2.29879 

2,18008 

2.29035 

2.57258 

2.9335) 

2.92114 

PIN? 

•1.82828 

•1.19356 

-2.2(715 

•l.((76( 

•2.91)19 

•1.96(00 

-1.82273 

-1.7(278 

-1.9)829 

•2.06010 

-.73085 

SECT 

.78619 

.69673 

.878(6 

.49253 

1.02452 

.827(9 

.72(31 

.79115 

.92144 

.84619 

•1. 13911 

PBS  RICT 

-2.99198 

•3.28063 

-3.612(1 

•3.217(3 

-3.8517? 

-3.29(7) 

-2.81(75 

-2.34561 

-2.51579 

-2.68132 

-5.09515 

TAIONT 

1.08817 

1.12837 

1.080(6 

(.05229 

(.26678 

.90544 

.9((82 

1.1(644 

1,17998 

1.37070 

.79759 

CPSP 

SRSP 

SRAC 

SPAT 

RGILVL 

PRWI 

BIC1 

PII.I8CI 

TAIONI 

PBIQ? 

BBC? 

CPSP 

812.70808 

SRSP 

128.20698 

330.37709 

SRAC 

18.05806 

27.46727 

287.(55)0 

SPAT 

308.71227 

128.29)12 

139.22107 

2083.1(960 

8QRLVL 

3.78858 

1.51408 

3.1(390 

37.99(29 

2.(152) 

PBIQI 

1.11(81 

1.77281 

-.21090 

3.0(012 

.18(81 

2,09572 

RICI 

.23885 

-.35757 

-.55(48 

-2.51305 

-.19)17 

-1.25279 

1.8275) 

CPSP 

SUP 

3BAC 

SPAT 

BGILVL 

F8I9I 

IIC1 

PBI.IICI 

TA10N1 

PIN? 

UC? 

FBI  RICI 

3.82615 

8.2)828 

-1.95171 

•3.33345 

-.10489 

2.2(359 

.96153 

10.32017 

TAtMl 

1.23(24 

.17820 

.82182 

(.595(5 

.2(5(9 

-.01858 

.01(55 

-.02182 

.55995 

PBIQT 

1.12484 

.32(71 

-.$8289 

-.57891 

-.29108 

.58(49 

-.23)18 

1.0357) 

-.06899 

1.24280 

IICT 

-.18805 

.285(9 

-.00)04 

•2.813(9 

.09(97 

-.12279 

.21023 

,2972) 

.03958 

-.89897 

1.027(3 

PRI  RICT 

(.21(68 

1.031(3 

•2.01292 

-7.88(97 

-.91024 

1.31727 

.0(0(5 

9.171)1 

-.06(40 

2.31978 

1.11539 

TAIONT 

1 .11183 

1.(5218 

.5(1(8 

).((((( 

.109(2 

.109(0 

-.09128 

.07802 

.07571 

.OHIO 

-.03221 

PBI.IICI 

TAXON? 

PRI  IICT 

10.61836 

TAXON? 

-.03257 

.6003? 
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NOS  131  -  Vitkin  Cells  Vsriancei  tnd  Corcriancea  •  Tine  and  Accuracy 
Pine  Motor  Diacrete 
Coiionicalion  -  Oral 


CL 

t  CO 

BL 

PA 

GB 

GT 

BB 

OP 

SC 

ST 

CPAC 

CL  » 

191.16202 

CO 

138.12533 

163.90781 

BL 

185.72525 

151.48362 

208.74674 

PA 

163.92215 

152.35572 

165.01184 

176.22790 

GN 

I63.7AA52 

156.63886 

197.85759 

145.86485 

213.53943 

CT 

179. 37215 

134.98149 

174.86234 

146.20598 

157.62112 

182.19021 

NN 

113.27263 

145.2(309 

145.24817 

123.14158 

165.72111 

112.01255 

166.24751 

OP 

12A. 21592 

140.35751 

119.12080 

123.08232 

155.60629 

125.52255 

141. (1601 

141.80610 

SC 

160.31205 

161.05621 

172.81890 

147.17799 

180.91941 

1(3.31235 

152.39827 

154.76549 

115.40348 

ST 

182.50054 

150.58647 

197.30414 

163.23941 

193.81202 

173.67443 

143.95692 

151.79104 

110.59467 

214.71018 

CPAC 

91.07387 

81.41279 

97.72603 

91.29061 

93.25260 

80.83585 

69.86383 

(9.21244 

78.0489) 

91.61(85 

536.36600 

CPSP 

28.13136 

25.68347 

33.28439 

34.41786 

22.49085 

29.36157 

21.02697 

22.06118 

23.31559 

35.35142 

-113.94161 

PSTN 

161.70246 

160.41296 

169.76029 

180.27631 

1SI.3108S 

154.79903 

135.91967 

141.051(1 

156.27543 

184.00197 

257.32380 

SRSP 

21.95327 

17.15138 

20.8)670 

27.41397 

9.25714 

21.42764 

10.52325 

14.(8464 

14.354)0 

24.55024 

29.1851) 

SBAC 

24. (5210 

33.23137 

30.22650 

24.01938 

37,42200 

27.52195 

36.50131 

35.22171 

39.724)1 

35.20242 

57.03834 

SPAT 

358.88335 

340.98613 

384.49189 

373.75167 

351.71512 

330.46458 

299.25243 

290.65213 

351.84199 

382.54126 

329.3(076 

FRI94 

•1.66614 

•1.73765 

•1.57190 

-1.71399 

•1.54102 

•1.695(1 

-1.4)190 

-1.59493 

•1.10165 

•1.(5090 

-2.112(1 

RICA 

1.42591 

1.21260 

1.65437 

1.30831 

1.60876 

1.33093 

1. 17911 

.99934 

1.40202 

1.53023 

1.59522 

FBI  RICA 

.22436 

-1.07713 

.86169 

-.60104 

.56733 

-.02217 

-.7(311 

-1.35965 

-.36417 

.036)9 

-3.08(41 

TAIORA 

.53074 

.66248 

.82715 

.63706 

.95220 

.37929 

.75311 

.58067 

.70542 

.79568 

.61214 

TIBIA 

•1.00301 

•1.49(12 

-1.52519 

- 1 • 1)891 

•1.74482 

-1.09)51 

-1.67231 

-1.43797 

-1.4(555 

-1.31950 

.01325 

TAIOBIA 

1.27326 

1.31079 

1.49269 

1.24508 

1.58195 

1.25546 

1.43214 

1.21791 

1.55)40 

1.34254 

.07(55 

TINIIA 

•1.31133 

•1.14046 

•1.21439 

•1.(2664 

-.98631 

•1.26569 

-.62322 

-.19419 

-1.060(9 

-1.54073 

-.21140 

CPSP 

PS7B 

SRSP 

SBAC 

SPAT 

PRIQ4 

RICA 

PII.RIC4 

TAIOB4 

TIBIA 

TAIOBIA 

CPSP 

AI4. 84197 

PSTN 

140.51671 

1216.24908 

SRSP 

30.20381 

150.404)9 

219.6)431 

SIAC 

7.(0152 

79.80149 

34.32766 

163.3926I 

SPAT 

til .144 15 

706. 71131 

107.52000 

14.30668 

1760.93164 

FRIQA 

1.20309 

-1.06571 

.96(65 

-.27994 

-4.14154 

.12711 

RICA 

.19454 

1. 73175 

-.25110 

.91503 

4.51025 

-.40187 

.55072 

PRI.IICA 

3.10321 

-.01012 

.59245 

1.99911 

2.20256 

.69017 

.601(3 

3.91(44 

CPSP 

PS7B 

SUP 

SIAC 

SPAT 

PII04 

IIC4 

PU.IIC4 

TAIORA 

TIII4 

TAIOBIA 

TAIORA 

.23325 

1. 01617 

.02201 

.62029 

3.17411 

.07734 

-.06(12 

.0(1(2 

.17452 

T1HIA 

-1.92211 

-2.13254 

-.25660 

-.(1552 

-5.73067 

-.01979 

.05410 

-.01124 

-.012)1 

.30717 

TAIOBIA 

.10114 

1.90157 

.27101 

.0256! 

4.16509 

.07455 

-.04623 

-.02999 

.04910 

-.0(2(1 

.37554 

TINIIA 

•1.07131 

•3.21339 

•1.49616 

.03238 

•2.10012 

-.07267 

.04(00 

.07925 

.94306 

.07219 

.0275) 

TIBIlA 

TIBIlA 

.64743 

D-2 


HOS  31C  -  VitEiin  Cell*  Variance!  and  Conriancet  •  Tiie  and  Accnncr 
Cognitive  -  Beatoning/Proble*  8olnn(/Deciaion  (Inking 


CL 

t  CO 

EL 

PA 

an 

GT 

RH 

OP 

SC 

ST 

CPAC 

CL  > 

165.2S004 

CO 

98.50251 

124.81841 

SL 

150.311(1 

113.612(8 

168.28208 

P* 

134.15899 

113.696(2 

130.83(11 

143.5(885 

GH 

120.80093 

111.11880 

154.86321 

106.318(1 

1(9.84553 

GT 

148.30(33 

92.11901 

135.14(30 

112.13321 

109.6933 1 

148.38186 

m 

25.19810 

109.13442 

109.52056 

85.50818 

130.12588 

11.81200 

01.52860 

OP 

88.52535 

91.01113 

100.9030) 

84.51235 

111.63641 

86.32414 

105.63585 

101.21111 

SC 

128.54511 

129.21592 

142.36548 

116.14400 

141.951(5 

121.95096 

126.52615 

120.95412 

1(3.391(3 

ST 

150.52338 

112.31395 

160.22941 

00.12581 

150.28336 

01.32109 

108.949(3 

113.51411 

150.21280 

118.23539 

CPAC 

36.33004 

25.521(1 

39.81018 

31.90(90 

36.83382 

32.1(218 

11.92150 

20.92(45 

26.22090 

39.14105 

468.41568 

CPSP 

40.11913 

40.80156 

48.38224 

50.11840 

40.60048 

32.001 

31.16548 

29.91995 

36.(4112 

<4.85855 

-221.40112 

NHSA 

1(1.1(344 

105.44590 

149.33181 

151.93343 

102.33841 

141.60294 

(3.14921 

11.02(88 

106.8(811 

129.03561 

40.16929 

SBAC 

29.10(39 

26.30044 

34.06541 

31.9(610 

21.05(01 

28.5023 

22.01523 

19.19210 

21.22665 

32.1(518 

22.11149 

SBSP 

19. ((290 

14.22803 

24.81902 

20.13443 

19.15118 

16.44012 

15.23325 

10.12293 

0.69236 

19.23319 

-15.039(9 

SPAT 

291.58010 

285.11120 

306.03(51 

324.31589 

214.68(0 

258.2093 

219.82199 

221.25190 

103.35449 

330.58388 

190.51486 

IGSLVL 

18.40113 

11.53512 

11.(8140 

13.91150 

0 .68919 

18.44(18 

8.98088 

10.15151 

15.9(816 

11.03864 

3.9(040 

PBR03 

-.25928 

1.03(43 

.281(2 

.31(54 

.65351 

-.08518 

1.44920 

.18001 

.90399 

.01405 

1.83842 

RIC5 

*1.22104 

•1.35206 

-1.44211 

-1.31102 

•1.35462 

-1.19214 

-1.354(2 

-1.09132 

•1.41(48 

•1.22213 

-.02308 

PBS  BSCS 

•4.38080 

•2.21201 

•3.63(15 

•3.42032 

-2.1010 

-4.01941 

-1.20)11 

-1.9(819 

•2.81111 

-3.51252 

4.128(8 

TA10V3 

2.13591 

1.555(1 

2.22118 

1.98)10 

1.90511 

1.11210 

1.251(1 

1.2301 

1.6(014 

2.05968 

2.058)9 

TIHS3 

•.(1(01 

-.81110 

•  69415 

-.99158 

-.52391 

-.54411 

-.19211 

-.84113 

-.11509 

-.55280 

-.1(199 

CPSP 

SUSA 

sue 

SUP 

SPAT 

IGILVL 

PBW3 

IIC) 

PII.IIC3 

mm 

TIKIS 

CPSP 

495.188(1 

HK9A 

150.02122 

5(8.20944 

SBAC 

(.943(1 

34.403(1 

214.14505 

SISP 

103.31151 

10.12921 

•1.(0112 

1(0.152)3 

SPAT 

221.1(520 

312.(5(83 

53.0(131 

93.441))  1185.1(01 

IGILVL 

4. Hill 

IS.5((94 

3.(1411 

2.221)1 

12.0151 

2.11009 

PBIQ3 

-1.90131 

.119(0 

•1.05050 

-1.50910 

•2.119(1 

-.111(8 

1.280)9 

BIC3 

•1.01212 

•1.1(152 

I.)05t2 

.4)134 

•1.22111 

-.14)19 

-.11114 

.I44K 

PII.IIC) 

•(.11011 

•3.95254 

2.2251) 

•2.21591 

•12.31913 

-.49213 

.82115 

.91289 

6.31421 

CPSP 

IMA 

9IAC 

SISP 

SPAT 

IGILVL 

ruai 

IIC) 

ru.tic) 

TM0I3 

Till) 

THOM 

-.01354 

2.5)344 

.1(394 

.1)222 

5.591(9 

.22111 

.1(028 

-.14119 

-.0(12) 

.28211 

TINS) 

-.91909 

-2  (III) 

.21)02 

-.48(19 

•(.92(41 

-.01(11 

-.05519 

.04224 

-.1011 

-.01(81 

.15238 

803  TIL  -  Vitkin  Cell*  Vtritacet  ud  Comitnee*  •  Tiie  ud  Aceincy 
CoauiicttioB  -  letdiif/lritiai 


CL 

*  CO 

8L 

FA 

GH 

GT 

M 

OF 

SC 

ST 

CPAC 

CL  » 

159.Z790C 

CO 

1 15,52215 

155.30721 

gL 

153.90041 

129.48787 

177.105*5 

FA 

131.85247 

138.14917 

138.228(8 

151.7(153 

CK 

135.00220 

139.45175 

173.75370 

127.(4935 

192.8(149 

or 

144.185(9 

101.84841 

137.284(1 

li(. 05994 

123.91413 

145.85151 

NN 

87.97482 

125.(7440 

118.28228 

103.(8913 

140.72438 

78.84(03 

135.21418 

OF 

99.20744 

120.37037 

111.45735 

102.1(574 

121.99000 

95.33217 

115.95355 

118.7(0(3 

SC 

135,77781 

149.708(3 

147.799(3 

132.1)578 

151.30749 

132.9(9(4 

130.92140 

132.92192 

1(8.11118 

ST 

151.18904 

132.20815 

1(5.0(382 

137.82444 

1(7.41(59 

1)7.92150 

118.81347 

125.91031 

10.25815 

178.73498 

CMC 

(0.780(3 

(0.59089 

53.55875 

(4.10531 

(0.(4750 

55.50(74 

44.39350 

47.(8837 

81.00228 

(8.25508 

381.17274 

CP8P 

27.47518 

48.52187 

42.57489 

43.77097 

41.14401 

20.78127 

43.72172 

37.11939 

41.14477 

43.97949 

•131.08711 

SKAC 

29.19414 

28.23858 

28.14310 

23.913(2 

29.03117 

33.02717 

19.1)328 

21.58(08 

30.75571 

34.75882 

57.04818 

81SP 

.11347 

15.71048 

.43983 

11.23040 

-.00548 

3.0(924 

2.(410 

3.94(43 

5.(843) 

.2(005 

-3.73404 

SPAT 

30(. 33918 

329.21234 

328.(1228 

338.235(9 

320.1(022 

273.1(33) 

2(2.77733 

2(1.07)0 

337.5)3(4 

345.75324 

20.78220 

BGBLVL 

17.97934 

13.54738 

17.072(9 

14.44)10 

15.37(35 

18.0021 

1.77372 

11.78844 

l(. 48152 

11.0931 

(.8023 

PIN! 

.01825 

.11028 

-.1(07 

.45(50 

-.43(57 

-.14120 

•>3415( 

-.32400 

-.3)918 

-.24974 

.  .5547) 

RICI 

'.34388 

-.0(935 

-.12274 

-.42125 

.12579 

-.18(35 

.24931 

.057(4 

.10171 

-.1(7(1 

-.31(42 

Fit  IICS 

'2.10908 

•1.3(451 

-2.07132 

-.11(70 

-2.34272 

•2.50(13 

-1.33754 

-1.10(27 

-2.410) 

-2.2011 

.14240 

TAIOII) 

2.55023 

2.00021 

2.33733 

2.47725 

2.00)24 

2.1)281 

1.245)3 

1.4(40 

!.)((!( 

2.33052 

2.7702 

Tims 

-.25878 

-.25235 

.25(28 

-.21010 

.35(24 

-.40725 

.23174 

-.1)10 

-.10545 

.0)1(9 

-.82054 

CPSP 

sue 

SUP 

SPAT 

BGBLVL 

PBIQl 

BBC) 

PU  .BICI 

TAIOII 

TUBS 

CPSP 

479.02324 

SIAC 

-31.54784 

1)9.34140 

SISP 

Tl. 18250 

4.21583 

1(2.0(507 

SPAT 

219.41080 

(9.00951 

53.4310 

1(71.01(17 

BQBLVL 

I.8I08I 

3.9(018 

.35(04 

33.(5572 

2.25531 

fSIQt 

.94(54 

.15709 

.1(4(9 

1.14)37 

-.013)1 

Oil) 

MCI 

-.41(35 

-.10013 

.010)7 

•2.17)15 

-.023(7 

-.0(71 

.0374 

FBI  BICI 

.70595 

-.01402 

.4(421 

•4.22552 

-.310(0 

.8040 

.110)5 

2.1420 

mom 

.84212 

.70119 

.401(4 

8.(4403 

.27014 

.14(11 

-.12510 

.0(3(7 

.23(11 

TIRtS 

•1.20449 

-.51158 

.22175 

-1(4)11 

-.04787 

-.1021) 

.075)0 

-.04121 

-.0444) 

.5(110 

DOS  J5B  *  litkia  Cells  Variance!  tad  Covariance!  *  Tiie  and  Acciucy 
Cognitive  -  Rmrleal 
fine  Rotor  Diicrete 


CL 

CO 

8L 

FA 

GR 

GT 

RR 

OF 

SC 

37 

CPAC 

CL  » 

88.94946 

CO 

5T.3036A 

94.98480 

BL 

73 .72800 

80.65891 

84.26511 

n 

so.um 

81.880t8 

71.21450 

99.84)14 

GK 

32. 51589 

65.01889 

74.21795 

53.25113 

88.15212 

GT 

77.24647 

54.71439 

64.24970 

65.92630 

45.89536 

78.51556 

NR 

37.145(0 

77.91410 

57.26024 

55.16474 

75.46014 

36.05555 

93.33444 

OF 

A2.6178! 

89.98671 

46.653(5 

53.65263 

59.1(730 

43.04882 

74.25017 

70.78325 

SC 

57.88193 

78.21907 

60.8963) 

63.09997 

67.77399 

59.55668 

71.9)173 

67.23663 

It. 49151 

ST 

81.51059 

53.44665 

64.01344 

60.11494 

61.07758 

54.59529 

49.11607 

(9.910(6 

51.86446 

66.77313 

CPAC 

21.07280 

20.2)309 

14.17112 

26.81029 

8.43748 

17.87225 

9.75(07 

11.19100 

10.21241 

9.14171 

416.10412 

CPSP 

18.32702 

22.13994 

13.30131 

29.09428 

11.93312 

9.20014 

19.3)475 

21.51076 

15.61036 

20.204(4 

-171.15935 

NN8A 

100.50395 

72.67536 

77.08181 

I02.F5I96 

45.61192 

86.36134 

52.01336 

11.79405 

52.13401 

54.95943 

27. 1(755 

PSTR 

AO . AS  1 12 

74.33015 

47.89160 

71.29021 

44.24141 

34.58794 

74.30216 

61.37641 

56.25361 

39.90167 

121.17299 

SRAC 

11.9(574 

13.35588 

12.41119 

14.11022 

11.17)39 

10.49325 

13.11796 

13.29315 

10.17311 

11.1419) 

35.9)515 

SISP 

10.(1(91 

13.25145 

7.33021 

16.93902 

3.49439 

9.82266 

7.56874 

11.349(5 

6.711)5 

9.03572 

-3.76334 

SPAT 

137.30931 

174,01013 

139.09559 

183.1(117 

122.02137 

111.313)1 

141.38111 

126.70119 

150.91191 

121.92223 

132.76216 

FIRM 

.07753 

.58127 

.40727 

.46(94 

.49(61 

-.14313 

.43777 

.19586 

.32063 

.21226 

-.21127 

lies 

-.51013 

-.40561 

-.60422 

-.5157) 

-.42506 

-.42465 

-.20515 

-.17921 

-.41006 

-.56049 

.21)91 

Fll  IIC1 

-1.21758 

.20654 

-.32447 

-.259(1 

.1)625 

-1.77158 

.55621 

-.20936 

-.54761 

-.10751 

-.00437 

TAIORI 

1 .41187 

1.61317 

1.54405 

1.74392 

1.4)911 

1.19142 

1,(2005 

1.213)2 

1.49253 

1.33159 

.5)495 

TIRI1 

-.1(334 

-t. 401)1 

-.73130 

-1.42192 

-.66117 

-.79167 

-2.01101 

•1. 13361 

•1.01454 

-.9)360 

-.75102 

fiio< 

-.21719 

.3(571 

.91227 

.04)17 

.239(0 

-.37949 

.10916 

-.06485 

.99225 

-.11331 

-.51182 

RICA 

-.491(2 

-.17675 

-.19141 

-.421(5 

-.33344 

-.32151 

-.95371 

-.14715 

-.24177 

-.33381 

.5261) 

FII  IIC  A 

-2.55521 

-.55104 

-1.42381 

*1.53999 

-.17(15 

•2.31164 

-.1711) 

-.99961 

•1.94610 

•1.61979 

.63532 

TAIORA 

.54(54 

1.0(129 

.10547 

.17115 

1.01152 

.34102 

1.0(159 

.14841 

.99454 

.73445 

.17196 

7IRI4 

-.12513 

-.71944 

-.49713 

-.41977 

-.71133 

-.22134 

-.94811 

-.67111 

-.69342 

-.41110 

.12411 

CPIP 

183  A 

Mil 

sue 

SUP 

SPIT 

78181 

OKI 

FUUC2 

TA1GI2 

Tlitl 

CPSP 

453.02147 

KRIA 

114.01918 

524.55)4) 

P3IN 

158.95414 

197,15113 

1133.93137 

sue 

(.7(153 

15.36712 

24.2(955 

131.21919 

VifchiB  Celii  Viriificei  tad  Couritncei  H03  J5B  (COIT.) 


CPSP  l 

MSA 

PSTB 

SBAC 

SUP 

S8SP  t 

TS.ITBOI 

47.33101 

11.79522 

-3.91821 

101.47392 

SPAT 

212.58395 

229 .73998 

447.24701 

52.74157 

59.73199 

FB1Q2 

1.2TI0I 

-.00665 

3.81184 

.31709 

.59375 

B8C2 

- t .33 168 

-1.13159 

•3.41*55 

-.11271 

-.24633 

FSB  R8C2 

.52916 

-3.5*713 

3.10309 

.*1902 

1.27*79 

TAI0II2 

.93939 

I. 644*7 

2.237(0 

.31410 

.15515 

TI882 

-1. 44131 

•1.53124 

-3.01520 

-.13193 

-.04241 

FB8Q4 

.12414 

-.37212 

2.71254 

.20211 

.4651* 

SICA 

-.9TI83 

-.91010 

-1.49374 

-.09521 

-.20499 

FSB  SICA 

-.928T6 

•3.121*5 

2.59227 

.34(2* 

.((9(1 

mom 

1 .51348 

1.5*119 

2.4519! 

.251(0 

.30091 

TIBIA 

-1.40351 

•1.0429* 

-2.15514 

.10904 

-.41100 

FIMA 

MCA 

FIIJMC4 

TAI0V4 

TIH84 

FSIOA 

.rim 

MCA 

-.mu 

.45599 

FBI  MCA 

.13012 

.73129 

4.32240 

TAION4 

.19021 

-.0(479 

.01711 

.23019 

TIIAIA 

-.03911 

.02100 

-.03711 

-.01911 

.15491 

SPAT 

FSIQ2 

B0C2 

FU.0IC2 

TAI0N2 

TINB2 

1240.79005 

2.2514* 

.1733? 

-1.50435 

-.4(005 

.71202 

3.4(111 

1.20279 

.5211? 

5.13212 

5.10840 

.10799 

-.09555 

.0*0(1 

.31339 

-4.50415 

-;04l*5 

-.00012 

-.09923 

-.0II3( 

.40979 

.55005 

.0  575 

-.27941 

1.04113 

.0(102 

-.02254 

-.7(5(5 

-.2700* 

.395(1 

.20(41 

-.053(2 

.002(1 

-.00714 

.52550 

.59((? 

3.23525 

-.91770 

-.05133 

4.13(19 

.11 ((9 

-.07919 

.11739 

.10305 

-.05415 

-3.17371 

-.0(150 

.03411 

-.095(4 

-.0(332 

.046(4 

D-6-  ‘ 


Variables  in  rottt  sat)  colint  tie  tie  folloBiti  totatioa: 
Variable  Label 


SPAT 

Overall  Spatial 

SORLVL 

Bead  inf  Grade  Level 

CPAC 

Coeplei  Pereeptsa]  Accuracy 

CPS'P 

Coaplei  Perceptual  Speed 

NN8A 

Itiaerical  Speed  t  Accuracy 

PSTN 

Payckoaotor 

SMC 

Siaple  leactioa  Accoracy 

SISP 

Staple  Reactiea  Speed 

CL 

ASYAS  Ceapoaite  •  CL 

CO 

ASY1R  Coapoaite  *  CO 

RL 

ASYAS  Ceapoaite  -  IL 

n 

ASYAS  Coapoaite  -  PA 

on 

ASVAR  Coapoaite  -  ON 

or 

ASYAS  Coapoaite  -  GT 

NR 

ASVAR  Coapoaite  •  IN 

or 

ASYII  Coapoaite  *  OP 

sc 

ASYAS  Coapoaite  •  SC 
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